-- Logs begin at Tue 2022-08-30 11:18:37 UTC, end at Tue 2022-08-30 12:28:00 UTC. -- Aug 30 11:59:17.984108 dv-cinder-839768-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 11:59:17.992645 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 11:59:17 2022] *** Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: nodename: dv-cinder-839768-2-iscsi Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: machine: x86_64 Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: clock source: unix Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: pcre jit disabled Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: detected number of CPU cores: 4 Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: current working directory: / Aug 30 11:59:17.994631 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: detected binary path: /usr/bin/uwsgi-core Aug 30 11:59:17.995427 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: your processes number limit is 47680 Aug 30 11:59:17.995427 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: your memory page size is 4096 bytes Aug 30 11:59:17.995427 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: detected max file descriptor number: 2048 Aug 30 11:59:17.995427 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: lock engine: pthread robust mutexes Aug 30 11:59:17.995427 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: thunder lock: enabled Aug 30 11:59:17.995427 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 11:59:17.995427 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 11:59:18.034381 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: Python main interpreter initialized at 0x55bcdd4f09c0 Aug 30 11:59:18.034381 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: python threads support enabled Aug 30 11:59:18.034381 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: your server socket listen backlog is limited to 100 connections Aug 30 11:59:18.034381 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: your mercy for graceful operations on workers is 90 seconds Aug 30 11:59:18.034697 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 11:59:18.034773 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: *** Operational MODE: preforking *** Aug 30 11:59:18.035041 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: *** uWSGI is running in multiple interpreter mode *** Aug 30 11:59:18.035041 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: spawned uWSGI master process (pid: 106177) Aug 30 11:59:18.035228 dv-cinder-839768-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 11:59:18.035770 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: spawned uWSGI worker 1 (pid: 106178, cores: 1) Aug 30 11:59:18.036127 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: spawned uWSGI worker 2 (pid: 106179, cores: 1) Aug 30 11:59:18.036290 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 11:59:18.685637 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 11:59:18.698306 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 11:59:19.767132 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:59:19.767132 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: from cryptography.utils import int_from_bytes Aug 30 11:59:19.767743 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:59:19.767743 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: from cryptography.utils import int_from_bytes Aug 30 11:59:19.777011 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:59:19.777011 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: from cryptography.utils import int_from_bytes Aug 30 11:59:19.777472 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 11:59:19.777472 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: from cryptography.utils import int_from_bytes Aug 30 11:59:22.239428 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 11:59:22.239998 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 11:59:22.240206 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 11:59:22.240559 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 11:59:22.240808 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 11:59:22.241242 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.241562 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.241878 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.242188 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.242507 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.242811 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.243123 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.243431 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.243746 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.244034 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.244345 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.244663 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-2-iscsi {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.244976 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.245276 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.245363 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 11:59:22.245727 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.245798 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 11:59:22.245872 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.246091 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 11:59:22.246181 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.246452 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 11:59:22.246582 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.246704 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 11:59:22.246833 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.247073 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.247239 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.247675 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.247796 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.247900 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.248029 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.248149 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.248878 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.248994 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.249113 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.249494 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.249633 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.249757 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.249894 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.250018 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.250131 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.250285 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.250412 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.250597 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.250725 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.250899 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.251032 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.251240 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-2-iscsi {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.251421 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-2-iscsi {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.251562 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.251696 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.251868 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.252019 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.252209 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.252336 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.252521 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.252648 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.252843 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.252989 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.253149 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.253300 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.253466 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.253591 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.253787 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.253977 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.254115 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.254283 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.254419 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.254586 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.254729 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.254892 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.255020 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.255223 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.255349 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.255533 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.255678 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.255840 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.256003 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.256166 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.256305 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.256472 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.256597 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.256768 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.256897 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.257065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.257200 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.257324 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.257467 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-2-iscsi {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.257602 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.257781 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.257908 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.258089 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.258216 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.258401 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.258722 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.258856 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.258979 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.259104 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.259263 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.259410 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.259581 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.259717 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.259880 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.260033 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.260205 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.260344 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.260504 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.260637 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.260801 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.260928 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.261098 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.261232 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.261395 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.261522 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.261693 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.261821 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.261992 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.262119 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.262302 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.262429 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.262607 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.262741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.262919 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.263048 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.263216 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.263343 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.263499 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.263623 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.264497 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.264647 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.264773 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.265036 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.265413 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.265620 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.265808 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.265985 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.266182 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.266389 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.266591 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.266811 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.266811 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.267192 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.267393 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.267605 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.267818 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.268097 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.268290 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.268468 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.268684 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.268902 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.269125 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.269344 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.269547 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.269746 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.269746 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.270122 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.270326 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.270501 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.270688 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.270861 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.271046 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.271224 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.271403 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.271569 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.271748 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.271919 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.272111 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.272279 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.272474 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.272673 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.272846 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.273025 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.273200 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.273388 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.273561 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.273739 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.273903 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.274070 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.274244 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.274446 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.274608 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.274795 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.275029 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.275213 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.275406 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.275614 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.275804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.276050 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.276248 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.276446 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.276629 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.276815 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.277011 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.277193 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.277385 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.277586 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.277791 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.277989 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.278185 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.278377 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.278510 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.278634 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.278757 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.278889 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.278889 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.279121 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.279250 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.279373 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.279543 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.279669 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.279792 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.279929 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280212 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280346 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280470 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280470 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280710 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280833 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.280961 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281093 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281216 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281366 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281490 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281621 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281621 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281860 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.281990 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282114 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282235 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282357 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282488 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282611 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282735 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282858 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.282979 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.283109 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.283250 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.283374 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.283503 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.283626 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.283749 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.283871 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284031 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284164 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284295 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284426 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284549 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284679 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284811 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.284942 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.285066 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.285188 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.285310 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.285432 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.285563 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.285686 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.285808 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.285938 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.286068 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.286191 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.286321 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.286444 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.286574 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.286698 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.286830 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.286963 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.287087 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.287208 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.287330 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.287459 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.287582 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.287716 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.287840 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.287978 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.288103 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.288225 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.288358 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.288495 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.288619 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.288751 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.288882 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.289013 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.289144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.289276 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.289413 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.289536 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.289658 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.289786 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.289922 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.290053 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.290176 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.290305 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.290428 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.290550 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.290680 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.290803 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.290925 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.291047 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.291169 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.291291 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.291493 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.291618 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 11:59:22.291741 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.291862 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292011 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292137 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292271 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292419 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292551 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292680 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292838 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.292966 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.293141 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.293270 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.293442 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.293570 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.293742 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.293869 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.294058 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.294186 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.294379 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.294505 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.294683 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.294818 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.294994 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.295156 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.295468 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.295599 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.295832 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.296050 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.296180 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.296379 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.296516 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.296709 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.296843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.297027 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.297155 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.297331 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.297457 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.297646 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.297771 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.297952 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.298079 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.298267 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.298401 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.298575 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.298713 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.298881 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.299007 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.299191 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.299348 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.299496 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.299630 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.299802 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.299937 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.300121 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.300244 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.300424 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.300570 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.300728 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.300862 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.301028 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.301156 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.301333 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.301472 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.301633 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.301760 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.301947 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.302073 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.302267 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.302395 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.302587 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.302751 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.302876 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.303006 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.303177 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.303305 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.303478 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.303612 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.303781 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.303908 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.304108 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.304248 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.304404 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.304530 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.304710 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.304837 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.305014 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.305141 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.305310 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.305443 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.305688 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.305834 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.305967 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.306091 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.306213 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.306336 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.306510 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.306655 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.306809 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.306937 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.307110 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.307245 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.307419 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.307550 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.307720 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.307847 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.308047 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.308183 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.308351 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.308485 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.308652 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.308778 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.308957 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.309091 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.309257 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.309392 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.309558 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.309683 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.309882 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.310008 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.310185 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.310306 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.310488 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.310614 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.311384 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.311526 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.311659 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.311934 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.312183 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.312307 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.312430 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.312565 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.312702 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.312834 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.312958 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.313121 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.313249 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.313416 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.313552 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.313717 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.313844 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.314014 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.314141 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.314342 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.314469 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.314601 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.314739 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.314871 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.315002 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.315157 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.315286 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.315471 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.315598 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.315770 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.315906 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.316091 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.316227 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.316388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.316514 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.316684 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.316810 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.317019 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.317147 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.317317 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.317443 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.317633 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.317771 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.317943 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.318069 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.318257 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.318383 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.318572 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.318706 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.318871 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.318997 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.319176 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.319393 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.319519 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.319651 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.319775 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.319899 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.320076 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.320207 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.320372 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.320509 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.320688 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.320825 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.320986 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.321112 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.321288 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.321416 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.321586 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.321718 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.321886 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.322019 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.322188 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.322322 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.322488 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.322616 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.322782 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.322914 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.323079 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.323212 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.323399 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.323527 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.323704 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.323831 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.324025 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.324155 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.324327 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.324455 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.324628 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.324765 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.324932 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.325064 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.325234 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.325360 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.325538 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.325674 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.325840 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.325959 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.326141 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.326347 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.327059 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.327370 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.327513 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.327683 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.327813 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.327997 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.328162 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.328306 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.328477 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.328604 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.328791 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.328925 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.329105 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.329233 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.329417 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.329544 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.329738 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.329867 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.330048 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.330176 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.330368 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.330487 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.330670 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.330794 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.330989 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.331117 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.331294 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.331420 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.331597 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.331732 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.331901 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.332059 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.332220 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.332345 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.332521 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.332647 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.332823 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.332957 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.333130 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.333264 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.333433 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.333572 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.333735 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.333861 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.334030 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.334158 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.334336 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.334476 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.334637 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.334764 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.334934 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.335069 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.335230 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.335372 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.335534 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.335653 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.335849 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.336024 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.336179 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.336318 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.336496 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.336622 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.336810 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.336937 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.337108 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.337237 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.337407 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.337533 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.337711 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.337843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.338012 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.338138 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.338310 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.338438 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.338607 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.338740 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.338903 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.339032 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.339236 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.339362 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.339536 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.339661 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.339835 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.339980 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.340166 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.340293 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.340473 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.340599 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.340775 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.340903 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.341081 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.341214 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.341382 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.341514 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.341686 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.341800 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.342039 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.342219 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.342373 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.342756 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.342884 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.343073 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.343199 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.343390 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.343517 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.343716 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.343849 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.344009 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.344146 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.344303 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.344439 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.344616 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.344750 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.344922 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.345054 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.345228 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.345371 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.345526 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.345654 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.345830 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.345957 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.346142 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.346277 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.346442 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.346704 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.346831 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.347029 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.347157 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.347339 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.347466 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.347639 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.347765 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.347964 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.348093 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.348302 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.348443 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.348609 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.348736 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.348910 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.349048 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.349226 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.349360 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.349524 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.349650 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.349827 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.349953 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.350126 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.350252 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.350424 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.350550 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.350731 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.351111 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.351280 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.351406 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.351579 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.351712 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.351878 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.352023 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.352207 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.352336 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.352505 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.352632 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.352800 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.352928 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.353097 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.353225 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.353395 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.353522 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.353702 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.353841 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.353999 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.354125 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.354302 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.354433 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.354598 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.354732 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.354905 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.355030 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.355204 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.355336 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.355500 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.355771 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.355905 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.356105 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.356226 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.356423 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.356550 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.356724 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.356851 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.357039 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.357165 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.357359 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.357498 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.357806 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.357947 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.358079 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.358322 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.358529 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.358664 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.358851 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.358979 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.359149 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.359284 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.359448 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.359583 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.359746 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.359881 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.360073 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.360201 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.360376 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.360502 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.360677 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.360806 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.360979 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.361105 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.361280 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.361406 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.361578 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.361705 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.361880 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.362015 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.362175 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.362309 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.362474 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.362609 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.362771 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.362897 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.363069 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.363207 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.363371 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.363504 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.363670 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.363795 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.364004 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.364146 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.364272 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.364396 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.364577 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.364713 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.364874 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.365010 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.365171 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.365297 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.365466 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.365600 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.365775 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.365910 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.366072 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.366200 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.366370 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.366504 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.366666 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.366794 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.366968 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.367095 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.367268 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.367395 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.367593 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.367722 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.367866 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.368006 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.368195 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.368322 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.368493 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.368623 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.368789 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.368918 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.369089 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.369230 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.369385 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.369520 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.369680 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.369808 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.369979 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.370115 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.370284 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.370417 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.370590 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.370724 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.370886 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.371020 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.371187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.371313 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.371482 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.371607 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.371779 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.371915 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.372095 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.372223 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.372396 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.372523 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.372692 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.372821 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.372987 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.373122 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.373900 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.374026 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.374159 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.374382 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.374511 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.374703 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.374830 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.375011 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.375148 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.375307 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.375432 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.375605 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.375738 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.375899 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.376066 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.376259 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.376387 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.376556 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.376691 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.376907 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.377033 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.377204 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.377332 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.377510 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.377636 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.377818 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.377946 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.378120 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.378245 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.378422 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.378547 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.378726 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.378859 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.379022 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.379149 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.379323 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.379448 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.379624 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.379759 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.379926 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.380086 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.380249 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.380376 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.380545 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.380673 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.380852 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.380977 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.381153 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.381292 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.381454 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.381580 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.381755 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.381889 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.382062 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.382202 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.382363 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.382489 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.382657 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.382781 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.382955 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.383098 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.383255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.383381 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.383554 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.383679 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.383852 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.384011 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.384178 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.384305 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.384483 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.384610 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.384783 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.384909 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.385084 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.385209 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.385386 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.385522 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.385689 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.385825 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.385986 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.386117 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.386286 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.386412 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.386585 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.386712 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.386881 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.387008 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.387193 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.387319 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.387493 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.387621 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.387787 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.387913 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.388111 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.388259 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.388392 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.388516 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.388696 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.388878 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.389099 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.389272 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.389520 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.389676 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.389826 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.389988 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.390126 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.390313 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.390442 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.390629 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.390764 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.390942 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.391075 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.391263 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.391392 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.391579 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.391710 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.391876 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.392033 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.392219 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.392345 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.392529 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.392656 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.392841 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.392978 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.393149 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.393289 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.393457 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.393584 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.393760 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.393896 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.394066 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.394194 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.394376 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.394501 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.394675 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.394811 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.394973 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.395108 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.395271 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.395399 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.395574 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.395706 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.395872 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.396014 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.396203 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.396337 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.396532 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.396650 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.396813 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.396940 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.397120 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.397254 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.397422 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.397591 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.397718 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.397896 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.398024 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.398198 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.398340 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.398515 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.398649 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.398830 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.399008 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.399190 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.399323 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.399451 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.399617 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.399751 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.399920 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.400104 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.400252 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.400386 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.400561 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.400688 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.400876 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.401016 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.401187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.401314 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.401490 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.401616 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.401814 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.401953 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.402131 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.402267 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.402437 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.402563 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.402752 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.402882 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.403082 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.403199 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.403385 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.403521 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.403692 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.403821 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.404035 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.404175 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.404341 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.405001 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.405254 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.405383 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.405662 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.405883 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.406009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.406141 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.406266 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.406425 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.406567 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.406750 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.406879 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.407133 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.407258 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.407442 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.407640 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.407766 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.407889 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.408180 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.408310 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.408484 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.408613 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.408784 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.408910 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.409099 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.409226 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.409397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.409525 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.409714 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.409841 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.410016 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.410142 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.410331 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.410459 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.410640 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.410774 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.410937 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.411063 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.411253 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.411395 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.411556 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.411684 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.411855 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.412025 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.412181 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.412309 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.412482 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.412610 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.412807 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.412941 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.413104 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.413229 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.413414 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.413548 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.413736 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.413873 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.414060 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.414188 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.414366 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.414493 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.414692 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.414829 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.415013 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.415146 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.415326 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.415453 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.415625 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.415751 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.415933 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.416109 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.416245 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.416369 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.416537 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.416674 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.416840 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.416968 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.417136 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.417263 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.417434 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.417562 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.417732 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.417859 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.418033 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.418158 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.418328 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.418462 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.418625 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.418759 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.418921 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.419058 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.419228 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.419354 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.419525 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.419658 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.419843 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.420002 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.420239 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.420491 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.420599 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.420876 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.421021 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.421231 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.421360 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.421568 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.421696 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.421866 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.421995 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.422188 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.422316 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.422493 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.422620 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.422810 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.422951 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.423123 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.423263 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.423432 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.423565 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.423740 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.423876 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.424073 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.424196 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.424383 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.424510 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.424690 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.424829 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.424999 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.425126 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.425300 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.425434 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.425608 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.425745 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.425916 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.426044 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.426223 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.426351 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.426547 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.426730 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.426859 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.427055 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.427186 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.427364 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.427501 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.427670 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.427805 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.427994 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.428136 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.428305 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.428441 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.428611 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.428736 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.428912 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.429047 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.429213 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.429348 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.429515 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.429640 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.429820 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.429945 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.430138 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.430265 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.430441 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.430568 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.430742 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.430869 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.431043 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.431171 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.431343 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.431469 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.431666 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.431798 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.431987 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.432116 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.432298 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.432431 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.432611 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.432747 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.432931 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.433060 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.433228 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.433354 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.433538 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.433679 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.433847 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.433982 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.434154 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.434274 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.434459 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.434590 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.434762 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.434889 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.435070 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.435197 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.435376 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.435512 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.436340 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.436524 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.436652 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.436867 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.437083 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.437239 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.437371 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.437553 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.437760 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.437891 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.438089 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.438230 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.438404 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.438534 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.438717 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.438857 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.439028 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.439157 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.439341 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.439548 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.439677 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.439854 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.440038 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.440205 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.440348 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.440525 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.440661 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.440841 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.440979 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.441150 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.441280 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.441462 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.441604 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.441781 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.441910 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.442080 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.442210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.442379 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.442518 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.442682 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.442820 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.442984 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.443115 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.443282 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.443421 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.443597 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.443727 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.443899 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.444053 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.444226 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.444353 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.444538 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.444667 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.444839 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.444968 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.445154 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.445362 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.445498 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.445699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.445828 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.446008 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.446147 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.446325 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.446468 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.446642 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.446765 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.446948 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.447076 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.447247 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.447376 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.447556 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.447685 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.447855 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.448018 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.448179 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.448308 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.448488 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.448619 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.448790 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.448928 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.449088 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.449216 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.449386 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.449523 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.449688 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.449921 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.450050 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.450234 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.450363 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.450564 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.450694 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.450857 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.450985 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.451175 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.451313 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.452075 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.452190 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.452358 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.452662 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.452810 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.452966 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.453104 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.453262 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.453392 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.453585 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.453711 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.453845 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.453980 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.454139 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.454268 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.454443 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.454579 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.454740 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.454877 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.455041 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.455171 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.455337 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.455467 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.455643 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.455774 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.455960 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.456093 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.456275 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.456508 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.456652 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.456851 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.456980 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.457168 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.457298 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.457491 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.457629 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.457808 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.457936 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.458115 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.458244 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.458418 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.458554 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.458725 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.458863 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.459027 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.459156 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.459331 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.459462 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.459644 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.459781 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.459980 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.460211 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.460354 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.460546 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.460675 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.460861 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.460991 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.461168 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.461298 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.461468 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.461598 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.461764 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.461896 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.462061 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.462192 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.462372 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.462501 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.462673 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.462802 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.462973 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.463102 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.463262 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.463391 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.463564 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.463700 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.463863 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.464038 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.464183 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.464311 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.464474 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.464612 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.464774 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.464910 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.465074 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.465201 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.465365 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.465504 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.465667 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.465797 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.465966 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.466093 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.466266 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.466472 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.466601 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.466725 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.466850 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.467012 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.467316 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.467468 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.467646 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.467909 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.468091 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.468218 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.468359 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.468487 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.468614 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.468808 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.468938 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.469121 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.469266 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.469446 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.469585 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.469759 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.469889 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.470068 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.470205 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.470380 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.470510 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.470704 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.470836 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.471015 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.471239 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.471369 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.471577 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.471707 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.471901 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.472067 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.472259 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.472388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.472591 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.472722 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.472900 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.473039 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.473206 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.473345 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.473515 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.473647 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.473819 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.473949 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.474135 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.474264 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.474440 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.474570 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.474746 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.474875 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.475057 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.475187 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.475366 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.475496 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.475680 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.475810 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.476264 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.476394 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.476565 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.476695 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.476864 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.477003 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.477168 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.477298 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.477473 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.477611 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.477774 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.477902 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.478073 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.478202 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.478369 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.478508 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.478670 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.478801 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.478966 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.479096 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.479262 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.479402 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.479559 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.479689 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.479862 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.480032 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.480173 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.480301 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.480471 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.480600 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.480767 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.480905 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.481046 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.481174 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.481346 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.481479 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.481644 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.481774 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.481941 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.482072 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.482241 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.482370 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.483051 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.483197 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.483492 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.483739 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.483898 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.484090 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.484245 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.484393 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.484567 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.484698 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.484893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.485022 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.485204 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.485343 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.485529 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.485659 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.485858 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.485989 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.486171 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.486314 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.486476 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.486603 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.486787 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.486915 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.487102 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.487232 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.487414 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.487544 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.487719 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.487848 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.488068 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.488201 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.488374 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.488503 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.488676 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.488803 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.488979 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.489109 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.489281 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.489418 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.489587 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.489717 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.489891 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.490026 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.490193 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.490331 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.490494 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.490633 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.490800 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.490927 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.491098 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.491226 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.491403 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.491541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.491706 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.491837 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.492031 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.492163 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.492340 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.492478 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.492638 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.492766 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.492938 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.493068 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.493240 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.493370 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.493539 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.493674 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.493840 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.493967 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.494139 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.494269 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.494446 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.494575 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.494746 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.494875 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.495047 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.495185 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.495345 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.495474 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.495649 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.495780 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.496006 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.496136 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.496286 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.496415 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.496587 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.496729 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.496907 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.497037 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.497224 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.497345 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.497531 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.497671 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.497848 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.497978 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.498188 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.498804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.499062 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.499244 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.499383 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.499590 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.499721 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.499909 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.500105 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.500234 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 11:59:22.500359 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.500564 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.500876 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.501188 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.501499 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.501808 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.502117 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.502423 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.502749 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.503074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.503380 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.503702 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.504048 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.504369 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.504682 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.504993 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.505320 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.505635 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.505944 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.506251 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.506559 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.506866 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.507181 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.507488 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.507796 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.508140 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.508454 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.508778 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.509101 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.509409 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.509734 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.510057 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.510403 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.510714 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.511051 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.511374 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.511685 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.512015 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.512320 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 11:59:22.512563 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 11:59:22.652728 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO dbcounter [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Registered counter for database nova_api Aug 30 11:59:22.667964 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO dbcounter [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Registered counter for database nova_api Aug 30 11:59:22.674390 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_db.sqlalchemy.engines [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.680952 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writer thread running {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:22.689034 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_db.sqlalchemy.engines [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.695464 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writer thread running {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:22.737998 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.context [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e804add6-fad7-42aa-9329-3e6b3bd26b8a(cell1) {{(pid=106179) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 11:59:22.741845 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 11:59:22.742326 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 11:59:22.746103 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 11:59:22.746103 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 11:59:22.746103 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 11:59:22.746971 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 11:59:22.749583 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO dbcounter [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Registered counter for database nova_cell0 Aug 30 11:59:22.753122 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.context [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e804add6-fad7-42aa-9329-3e6b3bd26b8a(cell1) {{(pid=106178) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 11:59:22.753572 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO dbcounter [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Registered counter for database nova_cell1 Aug 30 11:59:22.757049 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_concurrency.lockutils [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 11:59:22.757657 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_concurrency.lockutils [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 11:59:22.759249 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_concurrency.lockutils [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 11:59:22.759997 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_concurrency.lockutils [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 11:59:22.760441 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_concurrency.lockutils [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 11:59:22.761128 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_db.sqlalchemy.engines [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.762454 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_concurrency.lockutils [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 11:59:22.764399 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_db.sqlalchemy.engines [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.764930 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO dbcounter [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Registered counter for database nova_cell0 Aug 30 11:59:22.766866 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writer thread running {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:22.770618 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO dbcounter [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Registered counter for database nova_cell1 Aug 30 11:59:22.777703 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_db.sqlalchemy.engines [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.780090 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_db.sqlalchemy.engines [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.785272 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writer thread running {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:22.790421 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writer thread running {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:22.904938 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writer thread running {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:22.913419 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO dbcounter [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Registered counter for database nova_cell0 Aug 30 11:59:22.922233 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_db.sqlalchemy.engines [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.926842 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writer thread running {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:22.934237 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO dbcounter [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Registered counter for database nova_cell0 Aug 30 11:59:22.944122 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG oslo_db.sqlalchemy.engines [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 11:59:22.948551 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writer thread running {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 11:59:23.312931 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: WARNING keystonemiddleware.auth_token [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 11:59:23.320270 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: WARNING keystonemiddleware.auth_token [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 11:59:23.343145 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: WARNING keystonemiddleware.auth_token [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 11:59:23.350431 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: WARNING keystonemiddleware.auth_token [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 11:59:23.661792 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: WARNING keystonemiddleware.auth_token [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 11:59:23.667673 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: WARNING keystonemiddleware.auth_token [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 11:59:23.673091 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bcdd4f09c0 pid: 106179 (default app) Aug 30 11:59:23.675153 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 11:59:23.676442 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001832 Aug 30 11:59:23.676862 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Tue Aug 30 11:59:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 11:59:23.699931 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: WARNING keystonemiddleware.auth_token [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 11:59:23.706973 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: WARNING keystonemiddleware.auth_token [None req-df6a3ee1-d6b1-4f87-a727-b201f7a38eec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 11:59:23.712281 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bcdd4f09c0 pid: 106178 (default app) Aug 30 12:00:45.469843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:00:45.471568 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Aug 30 12:00:45.472492 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:00:45.490426 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writing DB stats nova_api:SELECT=3 {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:45.494118 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writing DB stats nova_cell0:SELECT=3 {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:45.495481 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writing DB stats nova_cell1:SELECT=3 {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:45.496986 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:46.401844 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-fc05e77a-ac2b-4f08-9201-832682a52ebd admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:00:46.433415 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-fc05e77a-ac2b-4f08-9201-832682a52ebd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953984 Aug 30 12:00:46.434172 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Aug 30 12:00:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:00:48.821868 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:00:48.822823 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-dba1c8e3-9cf8-497f-8e07-5d8e869062da None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001386 Aug 30 12:00:48.828750 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:00:49.267758 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-387486a5-d4af-42e9-bd53-bb176f27a0a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:49.365208 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-387486a5-d4af-42e9-bd53-bb176f27a0a3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.535479 Aug 30 12:00:49.366098 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:00:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:00:49.380916 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_api:SELECT=3 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:49.382192 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_cell1:SELECT=3 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:49.383238 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_cell0:SELECT=3 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:49.384480 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:00:49.606341 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-a548a004-b79a-48c6-ba2f-28838011a452 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:49.760340 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-a548a004-b79a-48c6-ba2f-28838011a452 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.385049 Aug 30 12:00:49.761139 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Aug 30 12:00:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:00:52.136416 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-387486a5-d4af-42e9-bd53-bb176f27a0a3 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:00:52.137427 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-387486a5-d4af-42e9-bd53-bb176f27a0a3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 30 12:00:52.138151 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:00:52.808827 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-ffae68a6-859f-4a39-910a-20452fe4de8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "id": "d1", "ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:52.927140 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-ffae68a6-859f-4a39-910a-20452fe4de8f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.782663 Aug 30 12:00:52.932038 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:00:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:00:52.941583 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-086fdfee-08af-45a7-881d-46cc75114a62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:53.068156 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-086fdfee-08af-45a7-881d-46cc75114a62 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130643 Aug 30 12:00:53.068754 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Aug 30 12:00:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:00:55.456836 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-ffae68a6-859f-4a39-910a-20452fe4de8f admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:00:55.457927 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-ffae68a6-859f-4a39-910a-20452fe4de8f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 30 12:00:55.458425 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:00:55.967980 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-bcab3187-a98e-4579-91a1-d2c0499285f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:56.046211 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-bcab3187-a98e-4579-91a1-d2c0499285f0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581589 Aug 30 12:00:56.046944 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:00:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:00:56.058672 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-88b26298-30c8-42a6-9703-8bc33dc37865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:56.141778 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-88b26298-30c8-42a6-9703-8bc33dc37865 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086649 Aug 30 12:00:56.146753 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Aug 30 12:00:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:00:58.535706 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-bcab3187-a98e-4579-91a1-d2c0499285f0 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:00:58.536724 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-bcab3187-a98e-4579-91a1-d2c0499285f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 12:00:58.537128 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:00:58.954780 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-eb79e83c-2754-4b7a-9644-291b14a856ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:59.029350 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-eb79e83c-2754-4b7a-9644-291b14a856ba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486019 Aug 30 12:00:59.030301 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:00:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:00:59.042116 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-2ffb5307-d885-4621-999b-d2497a73a63f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:00:59.126437 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-2ffb5307-d885-4621-999b-d2497a73a63f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088007 Aug 30 12:00:59.127168 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Aug 30 12:00:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:01:01.506439 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-eb79e83c-2754-4b7a-9644-291b14a856ba admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:01.507504 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-eb79e83c-2754-4b7a-9644-291b14a856ba admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 12:01:01.507898 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:01.955048 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-94c662f1-b994-421c-a980-c945bbb964ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "id": "d4", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:02.029520 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-94c662f1-b994-421c-a980-c945bbb964ed admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514610 Aug 30 12:01:02.030417 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:01:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:01:02.042759 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-a7907c07-d45b-4e2e-9b93-d6c84a0151db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:02.130597 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-a7907c07-d45b-4e2e-9b93-d6c84a0151db admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091748 Aug 30 12:01:02.131330 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Aug 30 12:01:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:01:04.764957 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-94c662f1-b994-421c-a980-c945bbb964ed admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:04.765972 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-94c662f1-b994-421c-a980-c945bbb964ed admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Aug 30 12:01:04.766391 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:01:05.235736 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-fd4eb27f-14ab-45b2-ab35-af07bbd4e331 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:05.269496 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-fd4eb27f-14ab-45b2-ab35-af07bbd4e331 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.496704 Aug 30 12:01:05.270091 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Aug 30 12:01:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:01:07.890144 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-94c662f1-b994-421c-a980-c945bbb964ed admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:07.891230 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-94c662f1-b994-421c-a980-c945bbb964ed admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 30 12:01:07.891645 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:08.321513 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-3236b203-1752-4e38-bdde-0bc4708475e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:08.383106 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-3236b203-1752-4e38-bdde-0bc4708475e4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.484824 Aug 30 12:01:08.383684 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:01:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:01:08.396217 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-5572d1ec-fd53-4207-848a-0458bc7a84ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:08.483264 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-5572d1ec-fd53-4207-848a-0458bc7a84ce admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090580 Aug 30 12:01:08.483745 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Aug 30 12:01:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:01:10.845133 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-3236b203-1752-4e38-bdde-0bc4708475e4 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:10.846159 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-3236b203-1752-4e38-bdde-0bc4708475e4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 30 12:01:10.846566 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:11.217154 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-3b12df70-f299-4c8e-92e9-0b9f073350c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "name": "m1.small", "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:11.297749 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-3b12df70-f299-4c8e-92e9-0b9f073350c1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444846 Aug 30 12:01:11.298303 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:01:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:01:11.310781 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-c07e743c-7225-437e-b6e3-4d369ea72284 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:11.392928 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-c07e743c-7225-437e-b6e3-4d369ea72284 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086366 Aug 30 12:01:11.393501 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Aug 30 12:01:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:01:13.867633 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-3b12df70-f299-4c8e-92e9-0b9f073350c1 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:13.869243 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-3b12df70-f299-4c8e-92e9-0b9f073350c1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Aug 30 12:01:13.869731 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:14.335779 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-72e96557-1c24-4b79-9aa4-e2cda5be8dd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "swap": 0}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:14.410471 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-72e96557-1c24-4b79-9aa4-e2cda5be8dd9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.534029 Aug 30 12:01:14.411391 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:01:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:01:14.423582 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-54ac64f1-45c5-4677-b224-26ef1c18c141 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:14.484776 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-54ac64f1-45c5-4677-b224-26ef1c18c141 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064709 Aug 30 12:01:14.488096 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Aug 30 12:01:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:01:16.899958 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-72e96557-1c24-4b79-9aa4-e2cda5be8dd9 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:16.900976 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-72e96557-1c24-4b79-9aa4-e2cda5be8dd9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 30 12:01:16.901372 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:01:17.350283 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eefa7357-8c6e-4a22-9749-ab9d6d438350 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "id": "4"}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:17.361235 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:17.435274 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eefa7357-8c6e-4a22-9749-ab9d6d438350 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.526294 Aug 30 12:01:17.436121 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:01:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:01:17.448494 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-1763c2ef-4721-455d-9e7b-b72752310213 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:17.540624 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-1763c2ef-4721-455d-9e7b-b72752310213 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096061 Aug 30 12:01:17.541423 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Aug 30 12:01:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:01:19.971344 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eefa7357-8c6e-4a22-9749-ab9d6d438350 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:19.972391 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eefa7357-8c6e-4a22-9749-ab9d6d438350 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 30 12:01:19.978341 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:20.426680 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-1efe823a-6371-48a7-86fc-8bd8a4d6a885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "id": "5"}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:20.492166 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-1efe823a-6371-48a7-86fc-8bd8a4d6a885 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.512701 Aug 30 12:01:20.492725 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Aug 30 12:01:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:01:20.505283 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-c884547e-95cd-4ae6-8c8b-5288e8f62106 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:20.631809 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-c884547e-95cd-4ae6-8c8b-5288e8f62106 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130024 Aug 30 12:01:20.632788 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Aug 30 12:01:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:01:39.959393 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-1efe823a-6371-48a7-86fc-8bd8a4d6a885 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:39.960444 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-1efe823a-6371-48a7-86fc-8bd8a4d6a885 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 30 12:01:39.960853 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:40.359634 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-aed7336e-5521-49b3-b6d7-a7c95658f405 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:40.377886 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-aed7336e-5521-49b3-b6d7-a7c95658f405 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410246 Aug 30 12:01:40.378427 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Aug 30 12:01:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:01:41.453071 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-1efe823a-6371-48a7-86fc-8bd8a4d6a885 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:41.454124 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-1efe823a-6371-48a7-86fc-8bd8a4d6a885 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 30 12:01:41.454582 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:41.973252 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-40eac0e9-a8d4-407b-b4f4-73ec86b218fa admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:41.979015 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.wsgi [None req-40eac0e9-a8d4-407b-b4f4-73ec86b218fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-40eac0e9-a8d4-407b-b4f4-73ec86b218fa admin admin] Request method failure captured: Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Accept: application/json Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Accept-Encoding: gzip, deflate Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Connection: keep-alive Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Content-Length: 0 Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Host: 10.222.0.42 Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Openstack-Api-Version: compute 2.90 Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Openstack-System-Scope: None Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: User-Agent: python-novaclient Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Auth-Token: gAAAAABjDfwl0U0I5W-A3eVEUH1ksTS6D6YmLpjzrtThS19TVEMzOB46GcZ4ookCexZ7YfIUXi79PbfhXRYwPcw0yTQFQc72PBb76FRT7CLrJ1yrfOFNdfY27t5TDrLgQl27TzHAiQuR-eA4xh3Tcf4OpsFxQy5TDfeWQOo9UWbtot3hYjk5zeI Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Domain-Id: None Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Domain-Name: None Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Identity-Status: Confirmed Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Is-Admin-Project: True Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Domain-Id: default Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Domain-Name: Default Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Name: admin Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Role: admin,member,reader Aug 30 12:01:41.982496 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Roles: admin,member,reader Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant: admin Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant-Name: admin Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User: admin Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Domain-Id: default Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Domain-Name: Default Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Id: 7ecc6860229c4c2e8d532015133a30e8 Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Name: admin Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: method: > Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: exception: Flavor 42 could not be found. Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: action_args: {'id': '42'} Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:01:41.984198 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:41.985074 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:41.986187 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-40eac0e9-a8d4-407b-b4f4-73ec86b218fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:01:41.987316 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-40eac0e9-a8d4-407b-b4f4-73ec86b218fa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391356 Aug 30 12:01:41.987316 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Aug 30 12:01:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:41.993676 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-11fe45ae-0ccc-4fb5-b7dd-67eb590255e2 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:41.998428 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:01:42.018886 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-11fe45ae-0ccc-4fb5-b7dd-67eb590255e2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028735 Aug 30 12:01:42.019432 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Aug 30 12:01:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:01:42.029983 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-640a5194-c79a-4082-996c-fa364a035266 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:42.053557 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-640a5194-c79a-4082-996c-fa364a035266 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027847 Aug 30 12:01:42.054104 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Aug 30 12:01:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:01:42.064536 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-8ac54d80-a254-48a8-b133-ec92407b315e admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:42.070261 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.wsgi [None req-8ac54d80-a254-48a8-b133-ec92407b315e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-8ac54d80-a254-48a8-b133-ec92407b315e admin admin] Request method failure captured: Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Accept: application/json Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Accept-Encoding: gzip, deflate Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Connection: keep-alive Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Content-Length: 0 Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Host: 10.222.0.42 Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Openstack-Api-Version: compute 2.90 Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Openstack-System-Scope: None Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: User-Agent: python-novaclient Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Auth-Token: gAAAAABjDfwl0U0I5W-A3eVEUH1ksTS6D6YmLpjzrtThS19TVEMzOB46GcZ4ookCexZ7YfIUXi79PbfhXRYwPcw0yTQFQc72PBb76FRT7CLrJ1yrfOFNdfY27t5TDrLgQl27TzHAiQuR-eA4xh3Tcf4OpsFxQy5TDfeWQOo9UWbtot3hYjk5zeI Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Domain-Id: None Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Domain-Name: None Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Identity-Status: Confirmed Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Is-Admin-Project: True Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Domain-Id: default Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Domain-Name: Default Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Name: admin Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Role: admin,member,reader Aug 30 12:01:42.073541 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Roles: admin,member,reader Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant: admin Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant-Name: admin Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User: admin Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Domain-Id: default Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Domain-Name: Default Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Id: 7ecc6860229c4c2e8d532015133a30e8 Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Name: admin Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: method: > Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: exception: Flavor 42 could not be found. Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: action_args: {'id': '42'} Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:01:42.079065 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:42.080863 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:42.082144 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-8ac54d80-a254-48a8-b133-ec92407b315e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:01:42.083342 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-8ac54d80-a254-48a8-b133-ec92407b315e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014417 Aug 30 12:01:42.083342 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Aug 30 12:01:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:43.039504 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-640a5194-c79a-4082-996c-fa364a035266 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:43.040528 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-640a5194-c79a-4082-996c-fa364a035266 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 30 12:01:43.040924 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:43.559601 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-c368971b-c433-4ff3-b4ef-75d374f00b5e admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:43.564883 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.wsgi [None req-c368971b-c433-4ff3-b4ef-75d374f00b5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-c368971b-c433-4ff3-b4ef-75d374f00b5e admin admin] Request method failure captured: Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Accept: application/json Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Accept-Encoding: gzip, deflate Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Connection: keep-alive Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Content-Length: 0 Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Host: 10.222.0.42 Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Openstack-Api-Version: compute 2.90 Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Openstack-System-Scope: None Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: User-Agent: python-novaclient Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Auth-Token: gAAAAABjDfwmdal_EUVJ6x9syJAz3QlLhE0u750_I1uYjFSc8nmtVHf0bX9yNn4imZPMKgwpIEykNe147CEcgk7bQIZuc6TG8YwKYaFF0AnsJp3G6o0ubisOdivuovnQCKEdNomL4qexeJU30jmPsWrQmElJfuKhjA9nqaeYdmHDBv3xxWXRPEE Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Domain-Id: None Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Domain-Name: None Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Identity-Status: Confirmed Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Is-Admin-Project: True Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Domain-Id: default Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Domain-Name: Default Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Name: admin Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Role: admin,member,reader Aug 30 12:01:43.566397 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Roles: admin,member,reader Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant: admin Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant-Name: admin Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User: admin Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Domain-Id: default Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Domain-Name: Default Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Id: 7ecc6860229c4c2e8d532015133a30e8 Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Name: admin Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: method: > Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: exception: Flavor 84 could not be found. Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: action_args: {'id': '84'} Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:01:43.567843 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:43.568699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.570009 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-c368971b-c433-4ff3-b4ef-75d374f00b5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:01:43.571248 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-c368971b-c433-4ff3-b4ef-75d374f00b5e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388819 Aug 30 12:01:43.571248 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Aug 30 12:01:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:43.578113 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-1fa14f9d-2064-4822-8f77-2d4450ca1b01 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:43.593534 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-1fa14f9d-2064-4822-8f77-2d4450ca1b01 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019733 Aug 30 12:01:43.594068 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Aug 30 12:01:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:01:43.603739 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-d391fdb6-4712-459f-a2a2-4aeacd8db4a7 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:43.619275 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-d391fdb6-4712-459f-a2a2-4aeacd8db4a7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019312 Aug 30 12:01:43.619792 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Aug 30 12:01:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:01:43.629040 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-3dc2acc8-6bd6-4e4c-873d-faf4e03a2df7 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:43.634219 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.wsgi [None req-3dc2acc8-6bd6-4e4c-873d-faf4e03a2df7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-3dc2acc8-6bd6-4e4c-873d-faf4e03a2df7 admin admin] Request method failure captured: Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Accept: application/json Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Accept-Encoding: gzip, deflate Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Connection: keep-alive Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Content-Length: 0 Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Host: 10.222.0.42 Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Openstack-Api-Version: compute 2.90 Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Openstack-System-Scope: None Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: User-Agent: python-novaclient Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Auth-Token: gAAAAABjDfwmdal_EUVJ6x9syJAz3QlLhE0u750_I1uYjFSc8nmtVHf0bX9yNn4imZPMKgwpIEykNe147CEcgk7bQIZuc6TG8YwKYaFF0AnsJp3G6o0ubisOdivuovnQCKEdNomL4qexeJU30jmPsWrQmElJfuKhjA9nqaeYdmHDBv3xxWXRPEE Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Domain-Id: None Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Domain-Name: None Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Identity-Status: Confirmed Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Is-Admin-Project: True Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Domain-Id: default Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Domain-Name: Default Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Name: admin Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Role: admin,member,reader Aug 30 12:01:43.635741 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Roles: admin,member,reader Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant: admin Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant-Name: admin Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User: admin Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Domain-Id: default Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Domain-Name: Default Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Id: 7ecc6860229c4c2e8d532015133a30e8 Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Name: admin Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: method: > Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: exception: Flavor 84 could not be found. Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: action_args: {'id': '84'} Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:01:43.637097 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:43.637893 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:43.638998 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-3dc2acc8-6bd6-4e4c-873d-faf4e03a2df7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:01:43.640096 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-3dc2acc8-6bd6-4e4c-873d-faf4e03a2df7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011664 Aug 30 12:01:43.640096 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Aug 30 12:01:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 12:01:44.617274 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-d391fdb6-4712-459f-a2a2-4aeacd8db4a7 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:44.618306 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-d391fdb6-4712-459f-a2a2-4aeacd8db4a7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 30 12:01:44.618699 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:45.142403 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-dd24a536-2ccd-4bfb-95c0-9cfc79f8ce34 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:45.148202 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.wsgi [None req-dd24a536-2ccd-4bfb-95c0-9cfc79f8ce34 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-dd24a536-2ccd-4bfb-95c0-9cfc79f8ce34 admin admin] Request method failure captured: Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Accept: application/json Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Accept-Encoding: gzip, deflate Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Connection: keep-alive Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Content-Length: 0 Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Host: 10.222.0.42 Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Openstack-Api-Version: compute 2.90 Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Openstack-System-Scope: None Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: User-Agent: python-novaclient Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Auth-Token: gAAAAABjDfwo5HawdwBShJAaBYI8HlaOGjjA7vI5_FLhsRRVisVkBMrxGUkSeztGS2Sq7LSHYkDGOydQ6HjhrVh2MXO8-QGRv3QxefoiwbkxDMelx8uX_IzGeR0fMuwiPDRiygyVIyzOHS-eq5ujFUMhN6sasnujj9U7wwiZajkyBH-t1qkJcLM Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Domain-Id: None Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Domain-Name: None Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Identity-Status: Confirmed Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Is-Admin-Project: True Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Domain-Id: default Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Domain-Name: Default Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Project-Name: admin Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Role: admin,member,reader Aug 30 12:01:45.149694 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Roles: admin,member,reader Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant: admin Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-Tenant-Name: admin Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User: admin Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Domain-Id: default Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Domain-Name: Default Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Id: 7ecc6860229c4c2e8d532015133a30e8 Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: X-User-Name: admin Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: method: > Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: exception: Flavor 451 could not be found. Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: action_args: {'id': '451'} Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:01:45.151210 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:45.152333 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.153835 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-dd24a536-2ccd-4bfb-95c0-9cfc79f8ce34 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:01:45.155046 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-dd24a536-2ccd-4bfb-95c0-9cfc79f8ce34 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395770 Aug 30 12:01:45.155046 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Aug 30 12:01:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:45.160602 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-c94cfb9d-3048-458c-8fb1-baeb516b1ae6 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:45.175487 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-c94cfb9d-3048-458c-8fb1-baeb516b1ae6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018404 Aug 30 12:01:45.176025 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Aug 30 12:01:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:01:45.185749 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:45.201179 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019462 Aug 30 12:01:45.201713 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Aug 30 12:01:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:01:45.210832 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-d6f4becc-6a7a-4663-9afd-ea831466a9e8 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:45.216309 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.wsgi [None req-d6f4becc-6a7a-4663-9afd-ea831466a9e8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-d6f4becc-6a7a-4663-9afd-ea831466a9e8 admin admin] Request method failure captured: Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Accept: application/json Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Accept-Encoding: gzip, deflate Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Connection: keep-alive Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Content-Length: 0 Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Host: 10.222.0.42 Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Openstack-Api-Version: compute 2.90 Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Openstack-System-Scope: None Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: User-Agent: python-novaclient Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Auth-Token: gAAAAABjDfwo5HawdwBShJAaBYI8HlaOGjjA7vI5_FLhsRRVisVkBMrxGUkSeztGS2Sq7LSHYkDGOydQ6HjhrVh2MXO8-QGRv3QxefoiwbkxDMelx8uX_IzGeR0fMuwiPDRiygyVIyzOHS-eq5ujFUMhN6sasnujj9U7wwiZajkyBH-t1qkJcLM Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Domain-Id: None Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Domain-Name: None Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Identity-Status: Confirmed Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Is-Admin-Project: True Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Domain-Id: default Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Domain-Name: Default Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Project-Name: admin Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Role: admin,member,reader Aug 30 12:01:45.217804 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Roles: admin,member,reader Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4bcdb830b37450eb046d1a11adb5971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant: admin Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant-Id: c4bcdb830b37450eb046d1a11adb5971 Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-Tenant-Name: admin Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User: admin Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Domain-Id: default Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Domain-Name: Default Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Id: 7ecc6860229c4c2e8d532015133a30e8 Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: X-User-Name: admin Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: method: > Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: exception: Flavor 451 could not be found. Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: action_args: {'id': '451'} Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:01:45.219388 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:45.222255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: ERROR nova.api.openstack.wsgi Aug 30 12:01:45.224023 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-d6f4becc-6a7a-4663-9afd-ea831466a9e8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:01:45.225370 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-d6f4becc-6a7a-4663-9afd-ea831466a9e8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011796 Aug 30 12:01:45.225370 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Aug 30 12:01:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 12:01:46.211751 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:46.212781 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 30 12:01:46.213172 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:46.742940 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-2abacc8c-f6dd-4be0-be24-b579403b79c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:46.798105 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-2abacc8c-f6dd-4be0-be24-b579403b79c7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.446451 Aug 30 12:01:46.798697 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Aug 30 12:01:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:01:47.773130 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:47.774456 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001783 Aug 30 12:01:47.774853 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:48.309536 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-b050ff20-cdcc-49a7-b060-a17b390c5e66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:48.386906 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-b050ff20-cdcc-49a7-b060-a17b390c5e66 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.475071 Aug 30 12:01:48.387736 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Aug 30 12:01:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:01:49.360838 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:49.361851 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 30 12:01:49.362247 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:49.905697 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-ed207061-b52e-4350-8457-1b522c711d6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:49.981088 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-ed207061-b52e-4350-8457-1b522c711d6e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.475113 Aug 30 12:01:49.981630 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Aug 30 12:01:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:01:50.948138 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:50.949138 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 30 12:01:50.949581 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:51.475201 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-97cd3bc5-5de2-4474-a751-67e4e83748c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:01:51.535867 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-97cd3bc5-5de2-4474-a751-67e4e83748c2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.447305 Aug 30 12:01:51.536452 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Aug 30 12:01:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:01:52.517285 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:52.518288 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 30 12:01:52.518693 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:01:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:01:53.037721 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-14406c63-8ab5-45b5-9df0-8fa6968e6435 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:01:53.060326 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-14406c63-8ab5-45b5-9df0-8fa6968e6435 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402279 Aug 30 12:01:53.060868 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Tue Aug 30 12:01:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:02:46.832450 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:02:46.833463 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-eb8dc30c-1925-41b0-8841-23b0d7736e7a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 30 12:02:46.833873 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Tue Aug 30 12:02:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:02:46.844955 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:47.237899 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-2b494989-0e0f-48b2-b191-a6c05b707852 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:02:47.259006 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-2b494989-0e0f-48b2-b191-a6c05b707852 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.418443 Aug 30 12:02:47.259482 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Aug 30 12:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:02:47.281493 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG dbcounter [-] [106178] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:02:47.285245 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-c87cbb19-5a2e-4f0e-8f06-1fd533f5da43 admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:02:47.292957 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-c87cbb19-5a2e-4f0e-8f06-1fd533f5da43 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012889 Aug 30 12:02:47.293443 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Tue Aug 30 12:02:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:02:47.304961 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-c47165cf-d3b6-4b47-983a-2d9db1f3f200 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:02:47.313248 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-c47165cf-d3b6-4b47-983a-2d9db1f3f200 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011853 Aug 30 12:02:47.313760 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Tue Aug 30 12:02:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:02:47.325479 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:02:47.333388 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011992 Aug 30 12:02:47.333897 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Tue Aug 30 12:02:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:02:47.345419 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-a3c46747-8d41-434d-9575-14fdcb02bf93 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:02:47.353345 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-a3c46747-8d41-434d-9575-14fdcb02bf93 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011372 Aug 30 12:02:47.353957 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Tue Aug 30 12:02:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:05:48.829316 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:05:48.830311 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 30 12:05:48.830703 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:05:48.970856 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_api:SELECT=6 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:05:49.132946 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:05:49.136524 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:05:49.137001 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:05:49.137427 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:05:49.138136 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:05:49.138579 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:05:49.138996 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:05:49.173357 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-ff4120df-a5cc-43c1-8a59-b8a96e441aae admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203932 Aug 30 12:05:49.173919 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Aug 30 12:05:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:05:49.995695 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:05:49.998010 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 30 12:05:49.998167 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:05:50.187118 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:05:50.190593 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:05:50.191071 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:05:50.192244 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:05:50.192960 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:05:50.193405 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:05:50.193817 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:05:50.212832 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-c8add9ba-e260-48ab-becc-63f0735e21f5 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076984 Aug 30 12:05:50.213315 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Aug 30 12:05:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:06:01.464517 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:06:01.465515 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 30 12:06:01.465907 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:06:01.611489 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_cell0:SELECT=4 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:06:01.612243 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_cell1:SELECT=4 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:06:01.612862 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG dbcounter [-] [106179] Writing DB stats nova_api:SELECT=8 {{(pid=106179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:06:01.661449 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:06:01.664816 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:06:01.665310 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:06:01.665728 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:06:01.666430 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:06:01.666864 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:06:01.667271 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:06:01.693462 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-a5b1bb16-c8ed-4b15-aa41-27496cd4ef7d admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085629 Aug 30 12:06:01.693944 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Aug 30 12:06:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:06:02.531089 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: DEBUG nova.api.openstack.wsgi [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] Calling method '>' {{(pid=106178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:06:02.532121 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: INFO nova.api.openstack.requestlog [None req-866974cc-d5df-42c6-a718-96efd5003d7f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 30 12:06:02.532526 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: [pid: 106178|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Aug 30 12:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:06:02.724544 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG nova.api.openstack.wsgi [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] Calling method '>' {{(pid=106179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:06:02.728207 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:06:02.728698 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:06:02.729121 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:06:02.729818 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:06:02.730252 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:06:02.730658 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: DEBUG oslo_concurrency.lockutils [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:06:02.752719 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: INFO nova.api.openstack.requestlog [None req-4127377d-bca1-45e5-a32a-21e075af98b1 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080065 Aug 30 12:06:02.753255 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: [pid: 106179|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Aug 30 12:06:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:07:00.234362 dv-cinder-839768-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 12:07:00.234989 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: Tue Aug 30 12:07:00 2022 - graceful shutdown triggered... Aug 30 12:07:00.235451 dv-cinder-839768-2-iscsi devstack@n-api.service[106178]: Gracefully killing worker 1 (pid: 106178)... Aug 30 12:07:00.235817 dv-cinder-839768-2-iscsi devstack@n-api.service[106179]: Gracefully killing worker 2 (pid: 106179)... Aug 30 12:07:01.235963 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: worker 1 buried after 1 seconds Aug 30 12:07:01.236547 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: worker 2 buried after 1 seconds Aug 30 12:07:01.236547 dv-cinder-839768-2-iscsi devstack@n-api.service[106177]: goodbye to uWSGI. Aug 30 12:07:01.237621 dv-cinder-839768-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 12:07:01.238173 dv-cinder-839768-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 12:07:01.241002 dv-cinder-839768-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 12:07:01.253218 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 12:07:01 2022] *** Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: nodename: dv-cinder-839768-2-iscsi Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: machine: x86_64 Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: clock source: unix Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: pcre jit disabled Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: detected number of CPU cores: 4 Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: current working directory: / Aug 30 12:07:01.255277 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: detected binary path: /usr/bin/uwsgi-core Aug 30 12:07:01.256136 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: your processes number limit is 47680 Aug 30 12:07:01.256136 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: your memory page size is 4096 bytes Aug 30 12:07:01.256136 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: detected max file descriptor number: 2048 Aug 30 12:07:01.256136 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: lock engine: pthread robust mutexes Aug 30 12:07:01.256136 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: thunder lock: enabled Aug 30 12:07:01.256136 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 12:07:01.256136 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 12:07:01.297541 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: Python main interpreter initialized at 0x55ae84cd89c0 Aug 30 12:07:01.297541 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: python threads support enabled Aug 30 12:07:01.297541 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: your server socket listen backlog is limited to 100 connections Aug 30 12:07:01.297541 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: your mercy for graceful operations on workers is 90 seconds Aug 30 12:07:01.297997 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 12:07:01.297997 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: *** Operational MODE: preforking *** Aug 30 12:07:01.298276 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: *** uWSGI is running in multiple interpreter mode *** Aug 30 12:07:01.298276 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: spawned uWSGI master process (pid: 121167) Aug 30 12:07:01.298485 dv-cinder-839768-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 12:07:01.299733 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: spawned uWSGI worker 1 (pid: 121191, cores: 1) Aug 30 12:07:01.299733 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: spawned uWSGI worker 2 (pid: 121192, cores: 1) Aug 30 12:07:01.299733 dv-cinder-839768-2-iscsi devstack@n-api.service[121167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 12:07:01.977696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 12:07:02.003093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 12:07:03.159053 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 12:07:03.159053 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: from cryptography.utils import int_from_bytes Aug 30 12:07:03.159777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 12:07:03.159777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: from cryptography.utils import int_from_bytes Aug 30 12:07:03.164831 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 12:07:03.164831 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: from cryptography.utils import int_from_bytes Aug 30 12:07:03.165391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 12:07:03.165391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: from cryptography.utils import int_from_bytes Aug 30 12:07:05.595353 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 12:07:05.596188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 12:07:05.596188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 12:07:05.596638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 12:07:05.596754 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 12:07:05.597077 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.597404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.597720 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.598039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.598529 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.598842 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.599430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.599748 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.600105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.600370 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.600686 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.601015 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-2-iscsi {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.601337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.601643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.601951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.602269 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.602574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.602899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.603217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.603717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.604190 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.604497 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.604807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.605150 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.605462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.605769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.606087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.606393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.606721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.607028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.607466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-2-iscsi {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.607759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.608094 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.608420 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.608830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.609143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.609451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.609771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.610093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.610399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.610721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.611068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.611397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.611698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.612067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.616733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.617316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.617316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.617316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.617316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.617645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.617858 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.618151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.618457 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.618769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.619083 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.619403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.619708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.620051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.620458 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.620710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.621014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.621354 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.621672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.621976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.622293 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.622612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.622915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.623219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.623522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.623835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.624191 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.624494 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.624744 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.625047 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.625349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.625663 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.625965 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.626265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.627138 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.627555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.627865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.628200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.628504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.628807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.629110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.629412 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.629741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.630016 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.630316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.630631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.630948 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.631251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.631554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.631855 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.632182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.632499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.632804 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.633107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.633429 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.633734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.634034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.634345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.634652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.634956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.635271 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.635574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.635989 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.636300 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.636606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.636909 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.637209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.637314 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 12:07:05.637787 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 12:07:05.637900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.637900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.638059 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 12:07:05.638186 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.638321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 12:07:05.638503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.638622 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 12:07:05.638714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.638938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.639032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.639253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.639350 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.639566 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.639672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.639872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.639986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.640204 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.640347 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.640509 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.640662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.640825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.640980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.641158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.641298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.641490 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.641615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.641831 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.641935 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.642142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.642943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.643087 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-2-iscsi {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.643243 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.643414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.643556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.643718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.643869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.644053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.644195 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.644349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.644501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.644659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.644813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.644976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.645113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.645273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.645375 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.645619 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.645806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.645965 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.646192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.646305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.646397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.646491 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.646610 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.646812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.646908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.647120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.647231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.647427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.647522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.647742 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.647837 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.648069 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.653198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.653988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.654186 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.654336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.654471 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.654471 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.654777 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-2-iscsi {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.654777 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.655024 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.655154 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.655389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.655542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.655690 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.655690 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.656016 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.656220 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.656374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.656540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.656695 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.656842 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.656988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.657146 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.657240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.657325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.657537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.657642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.657916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.658032 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.658127 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.658223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.658383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.658473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.658578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.658680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.659519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.659519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.659691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.659691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.659932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.660060 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.660147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.660239 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.660324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.660460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.660549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.660549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.660699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.660794 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.660886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.660970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.661066 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.661158 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.661242 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.661334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.661420 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.661517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.661604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.661732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.661834 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.661928 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.662014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.662111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.662205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.662297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.662388 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.662487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.662581 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.662675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.662675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.662844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.662936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.663028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.663123 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.663208 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.663298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.663389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.663480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.663572 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.663665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.663749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.663843 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.663935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.664056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.664150 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.664248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.664336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.664423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.664513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.664513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.664667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.664667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.664841 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.664925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.665017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.665017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.665185 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.665271 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.665361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.665361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.665513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.665513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.665684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.665769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.665859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.665943 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.666033 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.666033 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.666205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.666290 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.666381 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.666381 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.666548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.666633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.666732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.666824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.666914 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.666999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.667092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.667192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.667287 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.667287 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.667477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.667585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.667671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.667755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.668006 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.668123 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.668212 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.668304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.668390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.668481 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.668581 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.668678 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.668773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.668859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.668951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.669038 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.669131 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.669220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.669294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.669365 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.669452 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.669537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.669624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.669884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.670004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.670100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.670187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.670395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.670498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.670710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.670804 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.671037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.671139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.671323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.671424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.671620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.671718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.671915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.672038 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.672254 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.672350 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.672559 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.672667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.672857 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.672951 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.673157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.673256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.673480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.673601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.673814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.673913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.674114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.674390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.674507 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.674682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.674785 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.675003 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.675178 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.675317 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.675441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.675615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.675710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.676010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.679126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.679126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.679333 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.679421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.679513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.679599 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.679719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.679835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.679932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.680034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.680133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.680215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.680307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.680394 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.680484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.680578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.680658 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.680730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.680809 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.680881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.681040 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.681129 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.681223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.681308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.681396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.681488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.681568 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.681647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.681719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.681797 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.681797 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 12:07:05.681956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682037 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682281 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682354 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.682995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.683216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.683323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.684031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.684208 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.684208 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.684463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.684602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.684742 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.684954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.685095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.685230 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.685373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.685512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.685644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.685774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.685908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686041 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686180 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686312 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.686991 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.687130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.687269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.687402 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.687531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.687644 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.687757 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.687869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688501 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688588 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688681 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688768 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688853 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.688947 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.689724 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.689843 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.690053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.690263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.690365 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.690710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.690823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.691028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.691130 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.691415 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.691539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.691628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.691715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.691937 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.692073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.692509 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.692637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.692727 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.692813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.692959 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.693100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.693823 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.693932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694377 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694459 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.694962 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.695100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.695266 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.695408 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.695586 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.695731 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.695894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.696077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.696217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.696347 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.696511 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.696659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.696867 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.697011 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.697142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.697233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.697441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.697545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.697743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.697837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.698057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.698150 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.698401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.698501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.698657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.698759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.698962 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.699056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.699269 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.699371 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.699574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.699667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.699885 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.700013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.700225 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.700393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.700530 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.700633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.700836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.700943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.701142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.701240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.701450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.701552 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.701757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.701859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.702075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.702176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.702369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.702471 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.702670 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.702776 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.702974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.703077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.703274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.703377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.703574 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.703677 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.703883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.704544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.704544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.705403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.705510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.705614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.705710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.705840 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.706007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.706161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.706356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.706467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.706678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.706788 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.707029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.707124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.707349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.707498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.707644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.707743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.707986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.708148 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.708294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.708512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.708608 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.708694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.708895 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.708997 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.709201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.709348 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.709509 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.709610 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.709809 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.709900 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.710111 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.710209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.710408 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.710554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.710709 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.710810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.711007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.711099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.711306 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.711410 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.711600 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.711694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.711902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.712062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.712236 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.712345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.712533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.712626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.712833 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.712934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.713130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.713223 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.713439 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.713538 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.713737 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.713837 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.714035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.714132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.714332 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.714432 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.714628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.714727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.714955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.715047 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.715299 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.715391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.715641 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.715749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.716047 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.716167 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.716325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.716420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.716633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.716770 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.716944 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.717048 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.717266 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.717381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.717569 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.717680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.717870 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.717983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.718172 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.718282 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.718550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.718750 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.718908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.719062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.719214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.719362 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.719500 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.719673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.719813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.719982 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.720138 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.720277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.720486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.720627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.720798 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.720946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.721092 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.721238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.721392 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.721547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.721692 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.721839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.721991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.722136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.722304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.722463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.722619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.722765 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.722920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.723076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.723236 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.723383 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.723541 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.723637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.723773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.724208 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.724348 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.724443 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.724541 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.724741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.724880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.725044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.725139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.725345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.725439 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.725648 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.725740 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.725951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.726056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.726257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.726401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.726587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.726690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.726873 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.726985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.727180 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.727274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.727479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.727581 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.727783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.727877 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.728111 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.728207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.730696 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.730875 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.730976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731072 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731243 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731327 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731425 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.731914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732232 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732591 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732767 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.732936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733245 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733419 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733598 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733683 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.733942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734300 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734525 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734706 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734874 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.734959 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.735173 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.735280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.735483 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.735586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.735818 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.736043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.736180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.736346 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.736553 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.736696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.736828 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.736967 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.737067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.737271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.737367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.737572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.737668 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.737886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.737995 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.738206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.738301 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.738505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.738615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.738827 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.739011 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.739140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.739248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.739432 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.739533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.739747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.739856 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.740075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.740170 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.740383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.740479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.740690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.740795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.740994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.741094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.741298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.741392 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.741600 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.741703 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.741909 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.742054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.742218 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.742320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.742523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.742616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.742832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.742927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.743140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.743277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.743451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.743553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.743760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.743854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.744097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.744350 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.744457 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.744682 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.744786 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.744991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.745083 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.745303 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.745395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.745606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.745706 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.745928 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.746070 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.746423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.746594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.746923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.747070 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.747212 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.747381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.747667 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.747761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.747847 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.747973 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748162 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748532 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748713 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.748807 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.749015 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.749161 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.749313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.749418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.749617 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.749755 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.749917 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.750019 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.750218 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.750323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.750514 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.750619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.750813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.750914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.751122 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.751229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.751422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.751521 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.752344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.762914 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763659 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.763927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764237 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764440 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764526 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764617 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764853 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.764945 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765029 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765122 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765462 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.765973 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.766107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.766228 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.766354 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.766474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.766638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.766772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.766902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.767024 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.767143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.767437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.767611 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.767870 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.768061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.768189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.768324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.768487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.768638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.768795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.768943 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.769100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.769340 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.769500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.769647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.769821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.769969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.770125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.770279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.770426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.770572 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.771311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.771311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.771495 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.771634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.771734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.771836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.771938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772359 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772490 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772636 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.772985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773168 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773347 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773587 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773768 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.773955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774240 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774327 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774419 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774505 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.774923 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775108 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775193 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775374 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775561 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775804 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.775890 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776005 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776102 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776472 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776559 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776735 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.776827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777490 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777576 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777667 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777846 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.777932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778896 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.778981 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779638 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.779927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780172 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780848 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.780980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.781110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.781248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.781393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.781531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.781673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.781805 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.781934 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.782074 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.782213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.782359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.782458 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.782599 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.782692 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.783332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.783444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.783540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.783791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.783880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784066 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784581 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784682 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.784769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785400 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785573 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.785932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786106 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786191 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786276 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786817 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.786902 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787001 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787088 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787628 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787797 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.787888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.791875 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.791875 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792131 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792226 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792398 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792548 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792875 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.792969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793388 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793573 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.793942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794026 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794341 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794434 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794521 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794702 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.794884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795227 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795556 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.795911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796025 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796763 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.796962 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797102 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797193 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797364 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797798 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.797889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798153 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798238 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798510 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.798983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799159 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799242 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799481 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799781 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799893 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.799997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800444 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800618 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800703 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800794 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.800926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801630 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.801942 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.802071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.802267 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.802367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.802572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.802706 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.802878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.802971 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.803191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.803326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.803497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.803593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.803800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.803894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.804143 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.804258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.804453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.804765 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.804879 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.805074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.805194 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.805380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.805516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.805685 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.805785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.805983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.806081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.806299 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.806402 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.806598 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.806700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.806918 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.807013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.807221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.807321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.807528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.807711 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.807841 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.808023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.808176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.808273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.808479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.808572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.808783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.808914 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.809135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.809269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.809395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.809545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.809667 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.809797 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.809977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.810075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.810276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.810371 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.810597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.810700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.810898 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.811028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.811202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.811308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.811505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.811632 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.811813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.811908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.812144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.812238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.814860 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815272 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815842 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.815927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816242 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816341 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816521 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816870 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.816963 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817233 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817319 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817416 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817509 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817898 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.817984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818069 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818244 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818338 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818768 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.818954 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.819088 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.819255 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.819477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.819594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.819813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.819927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.820160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.820258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.820498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.820609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.820830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.820944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.821128 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.821241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.821436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.821554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.821739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.821855 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.822044 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.822138 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.822352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.822460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.822656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.822760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.822968 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.823090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.823270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.823442 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.823602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.823746 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.824179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.824348 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.824485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.824578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.824676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.824764 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.824921 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.825018 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.825105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.825325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.825590 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.825704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.825793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.825929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.826033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.826236 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.826441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.826549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.826644 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.826833 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.826929 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.827141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.827237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.827465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.827565 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.827776 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.827878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.828115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.828214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.828422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.828517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.828730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.828832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.829036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.829131 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.829341 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.829435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.829652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.830320 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.830574 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.830755 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.830933 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.831066 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.831265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.831437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.831533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.831667 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.831812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.832003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.832199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.832344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.832492 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.832637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.832803 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.832945 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.833099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.833269 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.833414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.833537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.833719 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.833847 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.834026 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.834166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.834334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.834473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.834643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.834799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.834961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.835159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.835304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.835463 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.835605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.835762 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.835913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.836067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.836206 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.836370 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.836520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.836674 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.836980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.837086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.837297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.837392 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.837606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.837701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.837906 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.838008 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.838210 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.838311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.838517 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.838612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.838821 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.838914 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.839125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.839220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.839429 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.839534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.839730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.839824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.840056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.840166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.840358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.840452 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.840658 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.840767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.840954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.841055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.841255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.841365 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.841556 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.841673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.841854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.841989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.842161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.842279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.842457 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.842758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.842857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.843058 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.843165 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.843358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.843452 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.843656 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.843758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.844005 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.844103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.844340 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.844443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.844651 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.844760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.844971 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.845065 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.845281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.845537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.845661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.845759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.845918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.846050 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.846278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.846375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.846602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.846727 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.846905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.847033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.847210 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.847309 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.847511 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.847615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.847810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.847906 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.848139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.848237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.848439 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.848535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.848745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.848839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.849301 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.849405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.849620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.849717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.849904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.849999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.850209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.850310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.850528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.850630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.850812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.850925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.851110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.851253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.851408 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.851529 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.851719 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.851839 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.852041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.852200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.852347 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.852454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.852645 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.852759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.852951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.853061 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.853251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.853352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.853556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.853682 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.853864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.854046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.854201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.854307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.854464 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.854549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.854832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.854991 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.855135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.855286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.855463 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.855619 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.855772 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.855919 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.856111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.856265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.856421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.856575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.856751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.856901 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.857048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.857200 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.857344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.857494 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.857665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.857810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.857967 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.858112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.858256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.858408 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.858551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.858694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.858844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.858994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.859144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.859298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.859470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 12:07:05.859566 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.859832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.860161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.860470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.860778 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.861718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.862157 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.862469 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.862779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.863087 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.863393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.863704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.864034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.864340 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.864644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.864949 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.865258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.865594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.865907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.866219 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.866530 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.866841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.867146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.867451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.867754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.868081 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.868393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.868716 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.869024 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.869323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.869740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.870047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.870361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.870675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.870980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.871294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.871608 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.871913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.872248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.872553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.872875 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.873208 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.873537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.873859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.874157 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.874457 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.874758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.875062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.875374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.875683 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.876003 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.876308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.876665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.877528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.877886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.878203 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.878507 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.878811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.879111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.879412 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.879709 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.880031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.880333 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.880632 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.880935 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.881233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.881532 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.881829 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.882130 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.882427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.882756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.883085 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.883394 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.883718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.884049 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.884371 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.884677 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.884995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.885312 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.885623 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.885929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.886253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.886559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.886866 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.887189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.887480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.887784 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.888111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.888434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.888754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.889054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.889374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.889687 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.889999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.890308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.890611 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.890934 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.891241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.891542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.891845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.892189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.892645 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.892960 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.893260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.893570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.893880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.894191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.894510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.894832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.895136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.895459 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.895781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.896151 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.896457 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.896791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.897115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.897437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.897728 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.898027 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 12:07:05.898264 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 12:07:05.920825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO dbcounter [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Registered counter for database nova_api Aug 30 12:07:05.942125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_db.sqlalchemy.engines [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:05.948860 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writer thread running {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:05.960712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO dbcounter [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Registered counter for database nova_api Aug 30 12:07:05.981020 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_db.sqlalchemy.engines [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:05.988570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writer thread running {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:06.008163 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.context [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e804add6-fad7-42aa-9329-3e6b3bd26b8a(cell1) {{(pid=121191) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 12:07:06.012375 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:07:06.012730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:07:06.014310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:07:06.015043 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:07:06.015495 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:07:06.018110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:07:06.020171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO dbcounter [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Registered counter for database nova_cell0 Aug 30 12:07:06.024306 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO dbcounter [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Registered counter for database nova_cell1 Aug 30 12:07:06.031614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_db.sqlalchemy.engines [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:06.034021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_db.sqlalchemy.engines [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:06.040393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writer thread running {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:06.041715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writer thread running {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:06.046787 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.context [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e804add6-fad7-42aa-9329-3e6b3bd26b8a(cell1) {{(pid=121192) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 12:07:06.051598 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:07:06.055279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:07:06.055279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:07:06.055279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:07:06.055537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:07:06.057915 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:07:06.059995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO dbcounter [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Registered counter for database nova_cell0 Aug 30 12:07:06.066321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO dbcounter [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Registered counter for database nova_cell1 Aug 30 12:07:06.073791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_db.sqlalchemy.engines [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:06.075504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_db.sqlalchemy.engines [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:06.081667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writer thread running {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:06.082923 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writer thread running {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:06.198488 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO dbcounter [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Registered counter for database nova_cell0 Aug 30 12:07:06.209056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_db.sqlalchemy.engines [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:06.214461 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writer thread running {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:06.235612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO dbcounter [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Registered counter for database nova_cell0 Aug 30 12:07:06.242919 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_db.sqlalchemy.engines [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 12:07:06.247592 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writer thread running {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 12:07:06.554765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: WARNING keystonemiddleware.auth_token [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 12:07:06.562561 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: WARNING keystonemiddleware.auth_token [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 12:07:06.572612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: WARNING keystonemiddleware.auth_token [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 12:07:06.580376 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: WARNING keystonemiddleware.auth_token [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 12:07:06.925186 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: WARNING keystonemiddleware.auth_token [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 12:07:06.928270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: WARNING keystonemiddleware.auth_token [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 12:07:06.931118 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: WARNING keystonemiddleware.auth_token [None req-e3682741-215b-4d52-8f96-aa51ca69306e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 12:07:06.934182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: WARNING keystonemiddleware.auth_token [None req-21e2b136-3f95-4317-b3a0-a2c88f38157c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 12:07:06.936481 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae84cd89c0 pid: 121191 (default app) Aug 30 12:07:06.939618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae84cd89c0 pid: 121192 (default app) Aug 30 12:07:45.000563 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:45.002224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:45.003569 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:45.004961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:46.398245 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fdaf52ee-e633-43bc-b220-5e01fe993633 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Action: 'create', calling method: .version_select at 0x7efe4fec6e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1266752868"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:07:48.622029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fdaf52ee-e633-43bc-b220-5e01fe993633 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.632039 Aug 30 12:07:48.625802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Aug 30 12:07:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3638 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 12:07:49.069275 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2ff698a8-dd06-4fc9-b8f4-b8a34d00daaf tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4ff289d0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:49.099502 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=3 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:49.100661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=3 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:49.101628 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=3 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:49.102520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=3 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:07:50.869280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2ff698a8-dd06-4fc9-b8f4-b8a34d00daaf tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417" status: 200 len: 346 microversion: 2.1 time: 2.231978 Aug 30 12:07:50.870539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:07:48 2022] GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 => generated 346 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:50.886629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cfc67e49-2407-49d6-9276-dc8597a42397 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Action: 'create', calling method: .version_select at 0x7efe4fd48c10>, body: {"snapshot": {"volume_id": "e00780e9-c359-4aea-8361-32424cdc0417", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-665737146"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:07:51.769338 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cfc67e49-2407-49d6-9276-dc8597a42397 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.887705 Aug 30 12:07:51.769850 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Aug 30 12:07:50 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:51.782412 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1ba17a15-e862-493e-bc77-7726134aef51 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd7bca0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:51.895307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1ba17a15-e862-493e-bc77-7726134aef51 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 200 len: 286 microversion: 2.1 time: 0.117185 Aug 30 12:07:51.895307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Aug 30 12:07:51 2022] GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:51.910135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-69b9c808-80a6-4ca9-98fb-9ca99cb940f0 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd60dc0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:52.056413 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-69b9c808-80a6-4ca9-98fb-9ca99cb940f0 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.154047 Aug 30 12:07:52.057470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Aug 30 12:07:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:52.069518 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1e6ac45d-f4ab-4892-abe5-3649fd12c1c6 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd7b940>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:52.164295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1e6ac45d-f4ab-4892-abe5-3649fd12c1c6 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 200 len: 286 microversion: 2.1 time: 0.098935 Aug 30 12:07:52.165232 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Aug 30 12:07:52 2022] GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:53.178139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cee84f5a-ab57-47fd-b1ae-13e8ba28f847 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd60af0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:53.307781 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cee84f5a-ab57-47fd-b1ae-13e8ba28f847 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 200 len: 286 microversion: 2.1 time: 0.132871 Aug 30 12:07:53.308791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Aug 30 12:07:53 2022] GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:54.321891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-24bca7be-488c-41c0-b093-1576379e9479 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd3f4c0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:54.385053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-24bca7be-488c-41c0-b093-1576379e9479 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 200 len: 286 microversion: 2.1 time: 0.068013 Aug 30 12:07:54.386100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Aug 30 12:07:54 2022] GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:55.399374 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-359cf34a-4a67-49bd-b768-ce79369f5b82 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd60550>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:55.473730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-359cf34a-4a67-49bd-b768-ce79369f5b82 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 200 len: 287 microversion: 2.1 time: 0.079432 Aug 30 12:07:55.475333 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Aug 30 12:07:55 2022] GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:55.488345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1123b09f-800c-4872-a3b3-2e55fb573f61 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd3fb80>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:55.749937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1123b09f-800c-4872-a3b3-2e55fb573f61 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 202 len: 0 microversion: 2.1 time: 0.266715 Aug 30 12:07:55.751111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Aug 30 12:07:55 2022] DELETE /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:07:55.780260 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bc78c814-e374-4e07-b1cb-37e8da25459c tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd48e50>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:55.849496 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bc78c814-e374-4e07-b1cb-37e8da25459c tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 200 len: 286 microversion: 2.1 time: 0.086745 Aug 30 12:07:55.851555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Aug 30 12:07:55 2022] GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:56.868479 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c79df66f-b32e-4f39-8a1c-1f04f2d537d8 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd3fc10>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:56.938110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-c79df66f-b32e-4f39-8a1c-1f04f2d537d8 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] HTTP exception thrown: Snapshot 8cfde9a9-57fd-46c7-8661-f69331fc3e44 could not be found. Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c79df66f-b32e-4f39-8a1c-1f04f2d537d8 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Request method failure captured: Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 HTTP/1.1 Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2QDHsydwsfdihN8oVogpB3IUO8CVB80wT30i_t2m4JCKzmutR1yf_1ez2ZV5J6ZuQysA4noCana8i-r47cdPObnOb_7R_GUZ7vmU6juuKfBmn0J0d9df_yG0gyU0erO08CGRq4FYXZ1XqKJHbzHEdPlkEPKIUJpukpMLP0bJ-0D4w Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:07:56.942546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 4ea1836cbebd4354a9031420527ef488 Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Snapshot 8cfde9a9-57fd-46c7-8661-f69331fc3e44 could not be found. Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '8cfde9a9-57fd-46c7-8661-f69331fc3e44'} Aug 30 12:07:56.943884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8cfde9a9-57fd-46c7-8661-f69331fc3e44 could not be found. (HTTP 404) (Request-ID: req-5741821a-bd5d-46fe-8637-d3bc2f40f03b) Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:56.944707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:07:56.945722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8cfde9a9-57fd-46c7-8661-f69331fc3e44 could not be found. Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 12:07:56.946812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8cfde9a9-57fd-46c7-8661-f69331fc3e44 could not be found. Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8cfde9a9-57fd-46c7-8661-f69331fc3e44 could not be found. Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c79df66f-b32e-4f39-8a1c-1f04f2d537d8 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Returning 404 to user: Snapshot 8cfde9a9-57fd-46c7-8661-f69331fc3e44 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c79df66f-b32e-4f39-8a1c-1f04f2d537d8 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44" status: 404 len: 111 microversion: 2.1 time: 0.085188 Aug 30 12:07:56.949656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Aug 30 12:07:56 2022] GET /compute/v2.1/os-snapshots/8cfde9a9-57fd-46c7-8661-f69331fc3e44 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:07:56.956461 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bed0bb0c-895a-4491-8725-e451827c229b tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd48af0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:57.277379 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bed0bb0c-895a-4491-8725-e451827c229b tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417" status: 202 len: 0 microversion: 2.1 time: 0.326906 Aug 30 12:07:57.278439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:07:56 2022] DELETE /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:07:57.288718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ef8380f5-9a55-480d-a580-c05913a2c697 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe5059f790>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:57.398035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ef8380f5-9a55-480d-a580-c05913a2c697 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417" status: 200 len: 345 microversion: 2.1 time: 0.114650 Aug 30 12:07:57.398609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 7/14] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:07:57 2022] GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:07:57.913527 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-631816844", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:07:58.107771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] validate_networks() for [('81e9b3a1-fda2-4dab-b74c-b9cbb69b5132', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:07:58.416142 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-05ee0300-8706-4fed-957d-315dd19c3646 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4ff289d0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:58.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-05ee0300-8706-4fed-957d-315dd19c3646 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] HTTP exception thrown: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-05ee0300-8706-4fed-957d-315dd19c3646 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Request method failure captured: Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 HTTP/1.1 Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2QDHsydwsfdihN8oVogpB3IUO8CVB80wT30i_t2m4JCKzmutR1yf_1ez2ZV5J6ZuQysA4noCana8i-r47cdPObnOb_7R_GUZ7vmU6juuKfBmn0J0d9df_yG0gyU0erO08CGRq4FYXZ1XqKJHbzHEdPlkEPKIUJpukpMLP0bJ-0D4w Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:07:58.489209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 4ea1836cbebd4354a9031420527ef488 Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': 'e00780e9-c359-4aea-8361-32424cdc0417'} Aug 30 12:07:58.490269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. (HTTP 404) (Request-ID: req-603a32ab-b56c-48b4-a7f4-4ba6f4b86b7a) Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.490878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:07:58.491756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 12:07:58.492666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.493528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.506647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-05ee0300-8706-4fed-957d-315dd19c3646 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Returning 404 to user: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:07:58.507802 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-05ee0300-8706-4fed-957d-315dd19c3646 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417" status: 404 len: 109 microversion: 2.1 time: 0.095639 Aug 30 12:07:58.513145 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:07:58 2022] GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:07:58.519832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-692a81a3-275b-498c-9080-9ff0d5c12bc6 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fcb43a0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:58.612974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-692a81a3-275b-498c-9080-9ff0d5c12bc6 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] HTTP exception thrown: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-692a81a3-275b-498c-9080-9ff0d5c12bc6 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Request method failure captured: Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: DELETE /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 HTTP/1.1 Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2QDHsydwsfdihN8oVogpB3IUO8CVB80wT30i_t2m4JCKzmutR1yf_1ez2ZV5J6ZuQysA4noCana8i-r47cdPObnOb_7R_GUZ7vmU6juuKfBmn0J0d9df_yG0gyU0erO08CGRq4FYXZ1XqKJHbzHEdPlkEPKIUJpukpMLP0bJ-0D4w Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:07:58.616207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 4ea1836cbebd4354a9031420527ef488 Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': 'e00780e9-c359-4aea-8361-32424cdc0417'} Aug 30 12:07:58.617540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. (HTTP 404) (Request-ID: req-df329893-30f7-40bf-9641-07c44e06ec5b) Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.618415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 12:07:58.619575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 12:07:58.620944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-692a81a3-275b-498c-9080-9ff0d5c12bc6 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Returning 404 to user: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:07:58.622230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-692a81a3-275b-498c-9080-9ff0d5c12bc6 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417" status: 404 len: 109 microversion: 2.1 time: 0.105969 Aug 30 12:07:58.626521 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:07:58 2022] DELETE /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:07:58.633405 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a44b70d7-f3c0-41ec-b677-1be96309a264 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Calling method '.version_select at 0x7efe4fd3fdc0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:07:58.693361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-a44b70d7-f3c0-41ec-b677-1be96309a264 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] HTTP exception thrown: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a44b70d7-f3c0-41ec-b677-1be96309a264 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Request method failure captured: Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 HTTP/1.1 Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2QDHsydwsfdihN8oVogpB3IUO8CVB80wT30i_t2m4JCKzmutR1yf_1ez2ZV5J6ZuQysA4noCana8i-r47cdPObnOb_7R_GUZ7vmU6juuKfBmn0J0d9df_yG0gyU0erO08CGRq4FYXZ1XqKJHbzHEdPlkEPKIUJpukpMLP0bJ-0D4w Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:07:58.695512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2f8062f2abd4a60bdbd4eed7c74b352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: e2f8062f2abd4a60bdbd4eed7c74b352 Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331432553 Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 4ea1836cbebd4354a9031420527ef488 Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331432553-project Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': 'e00780e9-c359-4aea-8361-32424cdc0417'} Aug 30 12:07:58.703936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. (HTTP 404) (Request-ID: req-fa6f6e81-0d8c-4d31-bbfa-6c277dcc37a4) Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.705849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:07:58.706980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 12:07:58.708093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a44b70d7-f3c0-41ec-b677-1be96309a264 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] Returning 404 to user: Volume e00780e9-c359-4aea-8361-32424cdc0417 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a44b70d7-f3c0-41ec-b677-1be96309a264 tempest-VolumesSnapshotsTestJSON-331432553 tempest-VolumesSnapshotsTestJSON-331432553-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417" status: 404 len: 109 microversion: 2.1 time: 0.069355 Aug 30 12:07:58.709156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:07:58 2022] GET /compute/v2.1/os-volumes/e00780e9-c359-4aea-8361-32424cdc0417 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:08:00.909159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:08:00.910102 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:08:00.910743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:08:00.911148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:08:00.911696 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:08:00.926629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:00.927364 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:00.927979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:00.928991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:00.929571 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:00.930201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:00.977596 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for project c040647b03574d3a87a335e10d02ef49. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:08:00.987347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for user 012ead000e8d411eae7034f296455fe7 and project c040647b03574d3a87a335e10d02ef49. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:08:01.003753 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:08:01.008280 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:08:01.214877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-36de4949-9691-4498-a19b-dd7e25e259f5 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.717724 Aug 30 12:08:01.225887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 8/18] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:07:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 3729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:08:01.241437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b355dbc1-279a-4683-a770-3f595cc6950e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:01.242823 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b355dbc1-279a-4683-a770-3f595cc6950e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:01.313871 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bbcd538e-c9b3-4900-8ac2-ffaa5937bfda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'create', calling method: .version_select at 0x7efe4fd08790>, body: {"keypair": {"name": "tempest-keypair-1154688898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGEI/fFM2RWRp96jxdkTJc2WeZ14km/9hWEO0XZ3BD5Uwh5/NgUeUeuA2sLoje9i293JVvrSk1CSoiTWJx5HIRqGksm0MzLdJaKGpxADD48nLYlvgcPPmh4hFU508r7vQ=="}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:01.500145 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-bbcd538e-c9b3-4900-8ac2-ffaa5937bfda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:08:01.535724 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-bbcd538e-c9b3-4900-8ac2-ffaa5937bfda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for user 1c1d151da5cb4b27a2bf9b71e82d70dc and project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:08:01.569067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b355dbc1-279a-4683-a770-3f595cc6950e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:01.632715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b355dbc1-279a-4683-a770-3f595cc6950e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1221 microversion: 2.1 time: 0.398998 Aug 30 12:08:01.651570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 9/19] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:01 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1221 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:01.760334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bbcd538e-c9b3-4900-8ac2-ffaa5937bfda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.071591 Aug 30 12:08:01.762041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 11/20] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Aug 30 12:08:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1075 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 12:08:02.524064 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-3641709", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:02.733413 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] validate_networks() for [('81e9b3a1-fda2-4dab-b74c-b9cbb69b5132', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:08:02.896976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-262298258", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "networks": [{"uuid": "73e9cb1d-1f26-4d22-a4ed-fa3c48d9533f"}]}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:03.060587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] validate_networks() for [('73e9cb1d-1f26-4d22-a4ed-fa3c48d9533f', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:08:03.991320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:08:03.991936 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:08:03.992484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:08:03.993149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:08:03.993639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:08:04.034896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:04.036643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:04.037258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:04.038635 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:04.043790 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:04.043790 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:04.070824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Getting quotas for project 5608b44a4c6542f4a0ec957c371f4cc9. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:08:04.075755 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Getting quotas for user d9f34590de854fd1aba73ae1b62de162 and project 5608b44a4c6542f4a0ec957c371f4cc9. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:08:04.090765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:08:04.095168 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:08:04.316371 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8ea9cce0-8f2e-465a-8b3c-abbbc4778acd tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.661620 Aug 30 12:08:04.319736 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 10/21] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:08:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:08:04.366566 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4ec8d846-f8e4-4bde-b953-5ade76165e2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:04.368938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4ec8d846-f8e4-4bde-b953-5ade76165e2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:04.577939 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4ec8d846-f8e4-4bde-b953-5ade76165e2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:04.588802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4ec8d846-f8e4-4bde-b953-5ade76165e2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1214 microversion: 2.1 time: 0.242726 Aug 30 12:08:04.592873 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 11/22] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:04 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:05.513163 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:08:05.515793 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:08:05.517633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:08:05.519121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:08:05.519810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:08:05.549515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:05.551084 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:05.551535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:05.553540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:05.554011 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:05.554443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:05.615596 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5c50d3e9-91b2-4b3c-a171-d7ce5cc5d3f0 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:05.616770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5c50d3e9-91b2-4b3c-a171-d7ce5cc5d3f0 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:05.646196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for project c040647b03574d3a87a335e10d02ef49. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:08:05.663145 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for user 012ead000e8d411eae7034f296455fe7 and project c040647b03574d3a87a335e10d02ef49. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:08:05.705385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:08:05.725275 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:08:05.945727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-54121c15-c932-4d2f-a5d7-a9d6cf75aa8f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.440841 Aug 30 12:08:05.949152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 12/23] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:08:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:08:05.961434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-04afb5b8-a508-4fdb-905e-0e8a26a7628e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:05.962074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-04afb5b8-a508-4fdb-905e-0e8a26a7628e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:06.053483 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5c50d3e9-91b2-4b3c-a171-d7ce5cc5d3f0 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:06.062675 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5c50d3e9-91b2-4b3c-a171-d7ce5cc5d3f0 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1214 microversion: 2.1 time: 0.452011 Aug 30 12:08:06.068008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:05 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1214 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:06.173305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-04afb5b8-a508-4fdb-905e-0e8a26a7628e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:06.202113 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-04afb5b8-a508-4fdb-905e-0e8a26a7628e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1219 microversion: 2.1 time: 0.244415 Aug 30 12:08:06.206014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:05 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1219 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:06.633939 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1253141742", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d40ebbd7-73a7-4467-b2ec-337128c5f770"}], "security_groups": [{"name": "tempest-securitygroup--1248204245"}], "key_name": "tempest-keypair-1154688898", "user_data": "}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:06.859390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a90086be-f58b-4949-97ab-58a9b4d8927e tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Action: 'create', calling method: .version_select at 0x7efe4f41bdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1931613414", "metadata": {"Type": "work"}}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:06.912955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] validate_networks() for [('d40ebbd7-73a7-4467-b2ec-337128c5f770', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:08:08.076355 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:08:08.085179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:08:08.085179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:08:08.085179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:08:08.085179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:08:08.111547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:08.118267 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:08.118792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:08.119814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:08.120582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:08.121111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:08.136643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a90086be-f58b-4949-97ab-58a9b4d8927e tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.689555 Aug 30 12:08:08.137564 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 13/26] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Aug 30 12:08:06 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1691 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 12:08:08.143358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:08.144010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:08.158918 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:08:08.162617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:08.163038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:08.163574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:08.164217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:08.168152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:08.168646 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:08.202265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for user 1c1d151da5cb4b27a2bf9b71e82d70dc and project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:08:08.230562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:08:08.238918 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:08:08.408677 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a3b28fc8-9499-4523-b107-b84fa2c8bfa5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.786605 Aug 30 12:08:08.413235 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 14/27] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Aug 30 12:08:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 12:08:08.432042 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:08.436836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:08.436980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:08.454870 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0278e6c6-f3fc-44cc-9fde-2a1a9d06c2d2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1266 microversion: 2.1 time: 0.316038 Aug 30 12:08:08.468738 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:08 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:08.477395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ad0f461a-6c2f-4ae5-ba73-dc116e5024fc tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Calling method '.version_select at 0x7efe4f32d9d0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:08.478454 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:08.479270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:08.480979 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:08.482017 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:08.488430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:08.490618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:08.949850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:08.999680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5ce1a01d-f658-4918-803a-189118bec9c6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1271 microversion: 2.1 time: 0.585049 Aug 30 12:08:09.000332 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:08 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1271 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:09.031205 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f77fbf8e-28f4-43df-85a7-994bacbc0669 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:09.035000 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f77fbf8e-28f4-43df-85a7-994bacbc0669 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:09.179039 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f77fbf8e-28f4-43df-85a7-994bacbc0669 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:09.191563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f77fbf8e-28f4-43df-85a7-994bacbc0669 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:09.207459 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f77fbf8e-28f4-43df-85a7-994bacbc0669 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:09.209106 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f77fbf8e-28f4-43df-85a7-994bacbc0669 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1282 microversion: 2.20 time: 0.198658 Aug 30 12:08:09.209704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 16/30] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:09 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:09.476732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:09.477592 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:09.505095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:09.505515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:09.505993 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:09.507054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:09.516931 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:09.516931 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:09.526984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ad0f461a-6c2f-4ae5-ba73-dc116e5024fc tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac" status: 200 len: 354 microversion: 2.1 time: 1.056521 Aug 30 12:08:09.527852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 15/31] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:08:08 2022] GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac => generated 354 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:09.542456 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9649870f-8bf0-48f7-9a19-1c818342f0d9 tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Calling method '.version_select at 0x7efe4f3360d0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:09.694570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:09.725666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-32d29e89-0462-4584-98ee-38e8d7799549 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1274 microversion: 2.1 time: 0.253995 Aug 30 12:08:09.741426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 17/32] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:09 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:09.958493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9649870f-8bf0-48f7-9a19-1c818342f0d9 tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac" status: 200 len: 354 microversion: 2.1 time: 0.420147 Aug 30 12:08:09.959587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 16/33] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:08:09 2022] GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac => generated 354 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:09.977388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-93d42b7a-87f6-4017-a90e-f12176ed197f tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Calling method '.version_select at 0x7efe4f2e1f70>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:10.023932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:10.025010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:10.046454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:10.046983 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:10.047427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:10.048183 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:10.048639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:10.049067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:10.286514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:10.315705 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9cc191ec-c653-4612-b119-0e779eb7ce57 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1279 microversion: 2.1 time: 0.295959 Aug 30 12:08:10.322805 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 17/34] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:10 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1279 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:10.331763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-efa0bdf7-27b6-4791-a3ea-20d58285322a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:10.332715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-efa0bdf7-27b6-4791-a3ea-20d58285322a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:10.518035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-93d42b7a-87f6-4017-a90e-f12176ed197f tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac" status: 202 len: 0 microversion: 2.1 time: 0.545584 Aug 30 12:08:10.524646 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 18/35] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:08:09 2022] DELETE /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:08:10.544147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-efa0bdf7-27b6-4791-a3ea-20d58285322a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:10.559183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cd2ab14b-be6b-4446-8335-21b18322e21f tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Calling method '.version_select at 0x7efe4f2e1dc0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:10.564188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-efa0bdf7-27b6-4791-a3ea-20d58285322a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:10.571487 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-efa0bdf7-27b6-4791-a3ea-20d58285322a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:10.572842 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-efa0bdf7-27b6-4791-a3ea-20d58285322a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1282 microversion: 2.20 time: 0.248840 Aug 30 12:08:10.583042 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 18/36] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:10 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:10.672792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cd2ab14b-be6b-4446-8335-21b18322e21f tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac" status: 200 len: 353 microversion: 2.1 time: 0.139482 Aug 30 12:08:10.674143 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 19/37] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:08:10 2022] GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:10.803181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:10.805267 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:10.818728 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:10.822918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:10.827485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:10.828666 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:10.829467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:10.830103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:11.059664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:11.076786 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1029060f-dcdd-4fdf-b4d4-e791786335f2 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1272 microversion: 2.1 time: 0.290367 Aug 30 12:08:11.083759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 19/38] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:10 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:11.345232 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:11.345948 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:11.361916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:11.367488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:11.368041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:11.375406 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:11.379350 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:11.381152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:11.617944 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:11.619461 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:11.630071 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:11.639802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:11.640411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:11.640757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:11.643432 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8dd1f621-528a-4b7d-8927-a4f218669504 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1277 microversion: 2.1 time: 0.299512 Aug 30 12:08:11.644270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 20/39] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:11 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:11.648310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:11.649047 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:11.649669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:11.687343 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-58883a1d-d33b-46b7-89a7-d590e9f7de15 tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Calling method '.version_select at 0x7efe4f271820>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:11.804885 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-58883a1d-d33b-46b7-89a7-d590e9f7de15 tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] HTTP exception thrown: Volume aed83136-f25c-43ea-bd77-5217420dafac could not be found. Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-58883a1d-d33b-46b7-89a7-d590e9f7de15 tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Request method failure captured: Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac HTTP/1.1 Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2mEFi3Om6k2Tn3eK2NYdATC8Kga116xsZbDXHeTUARwuERKAf-gN9HGRuo6_eu5IxQ0qiGeEJTev3OCPJ89EF48VTIl60O0aoizZ4a44dd54ddslb6GoCIYZU_uv8BE4czGiPssFtw2nVqEF5-lEPEMbyFgSJBg1hUCiQZcjc2mHs Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: b6f0c71f66e44c27b73f8687190bfcdb Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesGetTestJSON-22657359 Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:08:11.807339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6f0c71f66e44c27b73f8687190bfcdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6f0c71f66e44c27b73f8687190bfcdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6f0c71f66e44c27b73f8687190bfcdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6f0c71f66e44c27b73f8687190bfcdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesGetTestJSON-22657359 Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: b6f0c71f66e44c27b73f8687190bfcdb Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesGetTestJSON-22657359 Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesGetTestJSON-22657359-project Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 4003696ce0fc4df59010e82977483ea0 Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesGetTestJSON-22657359-project Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Volume aed83136-f25c-43ea-bd77-5217420dafac could not be found. Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': 'aed83136-f25c-43ea-bd77-5217420dafac'} Aug 30 12:08:11.812182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aed83136-f25c-43ea-bd77-5217420dafac could not be found. (HTTP 404) (Request-ID: req-4f0f00ee-0913-4980-a659-f56953f3e7e9) Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:11.813086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:08:11.814329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aed83136-f25c-43ea-bd77-5217420dafac could not be found. Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 12:08:11.815483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aed83136-f25c-43ea-bd77-5217420dafac could not be found. Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aed83136-f25c-43ea-bd77-5217420dafac could not be found. Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-58883a1d-d33b-46b7-89a7-d590e9f7de15 tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] Returning 404 to user: Volume aed83136-f25c-43ea-bd77-5217420dafac could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-58883a1d-d33b-46b7-89a7-d590e9f7de15 tempest-VolumesGetTestJSON-22657359 tempest-VolumesGetTestJSON-22657359-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac" status: 404 len: 109 microversion: 2.1 time: 0.126822 Aug 30 12:08:11.816823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:08:11 2022] GET /compute/v2.1/os-volumes/aed83136-f25c-43ea-bd77-5217420dafac => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 12:08:12.088252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:12.102079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:12.105591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:12.107133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-82d9caba-7c4e-450d-8cc4-7a239f5bd1e6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1334 microversion: 2.20 time: 0.501384 Aug 30 12:08:12.109181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:11 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1334 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:12.109894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:12.110743 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:12.121519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:12.126055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:12.126055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:12.126055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:12.126055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:12.126385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:12.537968 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:12.550031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5d6f2101-9df3-4e07-98bc-c3dff7bdc5e4 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1272 microversion: 2.1 time: 0.451522 Aug 30 12:08:12.575751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:12 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1272 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:12.596585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-6e49ec90-cc5a-45dc-8b03-4f3aae1c6f17 req-23fb8527-1a50-4506-8eaf-c64759ab48e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10ec061-4640-4100-bc70-536c1e6f263c", "tag": "397487c0-c694-4ca4-832b-a518e277191a"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:12.612992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6e49ec90-cc5a-45dc-8b03-4f3aae1c6f17 req-23fb8527-1a50-4506-8eaf-c64759ab48e1 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:12.613554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6e49ec90-cc5a-45dc-8b03-4f3aae1c6f17 req-23fb8527-1a50-4506-8eaf-c64759ab48e1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:12.614304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6e49ec90-cc5a-45dc-8b03-4f3aae1c6f17 req-23fb8527-1a50-4506-8eaf-c64759ab48e1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:12.640672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-6e49ec90-cc5a-45dc-8b03-4f3aae1c6f17 req-23fb8527-1a50-4506-8eaf-c64759ab48e1 service nova] Creating event network-changed:397487c0-c694-4ca4-832b-a518e277191a for instance f10ec061-4640-4100-bc70-536c1e6f263c on hv-cinder-83976 Aug 30 12:08:12.641325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6e49ec90-cc5a-45dc-8b03-4f3aae1c6f17 req-23fb8527-1a50-4506-8eaf-c64759ab48e1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121191) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 12:08:12.641569 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6e49ec90-cc5a-45dc-8b03-4f3aae1c6f17 req-23fb8527-1a50-4506-8eaf-c64759ab48e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121191) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 12:08:12.642890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:12.643835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:12.644926 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:12.645790 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:12.646428 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:12.647000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:12.656378 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.compute.rpcapi [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 12:08:12.657484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] Releasing lock "compute-rpcapi-router" {{(pid=121191) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 12:08:12.665560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:12.666811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:12.674370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:12.675215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:12.676161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:12.677345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:12.678555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:12.679823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:12.683013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-73dca75b-feec-43eb-8043-dccce3be2e29 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279143 Aug 30 12:08:12.684746 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 21/43] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:13.135624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:13.136355 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:13.153079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:13.153757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:13.157634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:13.158557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:13.159162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:13.167064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:13.503501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:13.527299 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:13.532861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:13.543268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a5ad585a-fdc5-4d0d-86e7-61008a4b84a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1342 microversion: 2.20 time: 0.410473 Aug 30 12:08:13.543268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:13 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1342 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:13.584754 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:13.586633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:13.614631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:13.624351 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:13.625985 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:13.628965 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:13.628965 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:13.628965 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:13.750978 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:13.780578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f6deadcc-7dd4-4ac9-857b-5e6049e1cba6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 1.118912 Aug 30 12:08:13.781220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 23/45] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:12 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:14.571433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:14.572544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:14.599940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:14.601370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:14.603722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:14.605273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:14.605957 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:14.606771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:14.719083 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:14.726153 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:14.728100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:14.729684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0b80ea81-6893-48f0-a021-e3c475f70550 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1340 microversion: 2.20 time: 0.161847 Aug 30 12:08:14.730713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:14 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1340 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:08:14.740480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:14.761247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ebeff7fc-fa8a-49bf-8bde-f1d97c0ce675 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 1.184195 Aug 30 12:08:14.762856 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 23/47] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:13 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:14.802960 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:14.803649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:14.813910 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:14.814405 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:14.814842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:14.815543 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:14.816124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:14.816583 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:15.699020 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:15.723179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7d2bc0c4-8c33-4d93-95df-34c9dbbbb3a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.922306 Aug 30 12:08:15.728149 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:14 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:15.756552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:15.757155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:15.764315 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:15.771630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:15.771630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:15.771630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:15.771630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:15.772045 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:15.787546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:15.788782 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:15.811064 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:15.814946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:15.817316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:15.818633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:15.821498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:15.834836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:16.451493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:16.465952 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:16.469628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:16.471399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f778a822-9d45-4078-b71e-af0e9a26bf97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1340 microversion: 2.20 time: 0.718712 Aug 30 12:08:16.473234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:15 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1340 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:16.480915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-a3160ccb-5a80-4683-8198-19a719481bd7 req-95506889-c5da-42d6-9f5e-9d1cd1679e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce796eb4-8b4c-4bfd-9192-af2720e5ffe7", "tag": "9cc8c7f0-1c17-42d8-8435-61b13a40d2d0"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:16.495332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-a3160ccb-5a80-4683-8198-19a719481bd7 req-95506889-c5da-42d6-9f5e-9d1cd1679e38 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:16.496454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-a3160ccb-5a80-4683-8198-19a719481bd7 req-95506889-c5da-42d6-9f5e-9d1cd1679e38 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:16.497309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-a3160ccb-5a80-4683-8198-19a719481bd7 req-95506889-c5da-42d6-9f5e-9d1cd1679e38 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:16.509837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:16.515597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5af6acdd-8512-43c2-9fd3-691ed4d350b9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.736455 Aug 30 12:08:16.516216 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 26/50] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:15 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:16.530810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-a3160ccb-5a80-4683-8198-19a719481bd7 req-95506889-c5da-42d6-9f5e-9d1cd1679e38 service nova] Creating event network-changed:9cc8c7f0-1c17-42d8-8435-61b13a40d2d0 for instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 on hv-cinder-83976 Aug 30 12:08:16.539974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-a3160ccb-5a80-4683-8198-19a719481bd7 req-95506889-c5da-42d6-9f5e-9d1cd1679e38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064005 Aug 30 12:08:16.547341 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 25/51] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:16.753881 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:16.754620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:16.766251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:16.766961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:16.767219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:16.771897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:16.772736 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:16.776769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:16.959131 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-fec07a0f-a3d4-4450-936e-e6d624858856 req-ffe9c97b-df4a-43ed-ada2-1c0a3104da74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393867e8-3598-4477-a515-e0e91f5ff5df", "tag": "bd985017-5118-4030-bf51-25ac4f9eb763"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:16.994657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fec07a0f-a3d4-4450-936e-e6d624858856 req-ffe9c97b-df4a-43ed-ada2-1c0a3104da74 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:17.001036 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fec07a0f-a3d4-4450-936e-e6d624858856 req-ffe9c97b-df4a-43ed-ada2-1c0a3104da74 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:17.005673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fec07a0f-a3d4-4450-936e-e6d624858856 req-ffe9c97b-df4a-43ed-ada2-1c0a3104da74 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:17.071526 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-fec07a0f-a3d4-4450-936e-e6d624858856 req-ffe9c97b-df4a-43ed-ada2-1c0a3104da74 service nova] Creating event network-changed:bd985017-5118-4030-bf51-25ac4f9eb763 for instance 393867e8-3598-4477-a515-e0e91f5ff5df on hv-cinder-83976 Aug 30 12:08:17.072279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fec07a0f-a3d4-4450-936e-e6d624858856 req-ffe9c97b-df4a-43ed-ada2-1c0a3104da74 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121192) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 12:08:17.072801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fec07a0f-a3d4-4450-936e-e6d624858856 req-ffe9c97b-df4a-43ed-ada2-1c0a3104da74 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121192) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 12:08:17.074411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:17.075377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:17.077276 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:17.078231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:17.078851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:17.080478 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:17.112567 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.compute.rpcapi [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 12:08:17.113854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] Releasing lock "compute-rpcapi-router" {{(pid=121192) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 12:08:17.166786 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a8650ef6-82e6-47d3-98c3-0dde7ce81ef4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.644607 Aug 30 12:08:17.168807 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 27/52] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:17.402181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:17.420409 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d444d9e9-0399-41e2-87ed-c5ee86ed5218 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.671725 Aug 30 12:08:17.436182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 26/53] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:16 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:17.502614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:17.507876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:17.542994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:17.543924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:17.546247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:17.551334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:17.554390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:17.555858 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:17.558024 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:17.561293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:17.563073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:17.563396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:17.568142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:17.569080 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:17.571059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:17.571680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:18.219259 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:18.236924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:18.241964 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:18.245513 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9bb61488-b80c-4f1f-aa53-fd0bd1a5a1a9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.754496 Aug 30 12:08:18.249120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 28/54] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:17 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:18.316630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:18.334148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d31db1c7-9c8e-4fae-8b86-cba498c86154 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.795607 Aug 30 12:08:18.336516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 27/55] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:17 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:18.446998 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:18.447606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:18.460605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:18.461091 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:18.461524 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:18.462230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:18.462674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:18.463089 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:18.969696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:18.996251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a04c1356-ba01-4972-a6ef-7b7149a73b19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.552960 Aug 30 12:08:19.000556 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 29/56] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:18 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:19.276699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:19.277576 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:19.292031 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:19.292865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:19.293522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:19.296398 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:19.297135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:19.299427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:19.371032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:19.371032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:19.371032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=20 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:19.379601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:19.380137 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:19.380578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:19.381362 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:19.384577 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:19.385295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:19.582273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:19.627214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c4b5a07e-1d84-42f6-84b9-c5729706bd27 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.263938 Aug 30 12:08:19.633177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 30/57] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:19 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:19.848805 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:19.863370 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:19.865957 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:19.897877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-beb0d79c-92bc-4f7a-9bc9-bb8e2f21202f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.625030 Aug 30 12:08:19.905433 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 28/58] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:19 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:20.023419 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:20.025555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:20.043764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:20.046974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:20.047820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:20.049130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:20.049806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:20.050455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:20.413525 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:20.432197 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-80eddf93-3b7f-4503-859c-5a0a06cd4c25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.409739 Aug 30 12:08:20.433336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:20 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:20.459808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-d0b39d7e-dd44-4140-bfb5-60966f47a237 req-13f95d6a-e35b-431b-ba0b-ad2deb2a4c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294a2d1c-a5ff-4f5e-945f-03a42a7800cc", "tag": "1a156fe5-05f5-48b0-bb53-3f8c98e5846a"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:20.498120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d0b39d7e-dd44-4140-bfb5-60966f47a237 req-13f95d6a-e35b-431b-ba0b-ad2deb2a4c4f service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:20.500679 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d0b39d7e-dd44-4140-bfb5-60966f47a237 req-13f95d6a-e35b-431b-ba0b-ad2deb2a4c4f service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:20.501869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d0b39d7e-dd44-4140-bfb5-60966f47a237 req-13f95d6a-e35b-431b-ba0b-ad2deb2a4c4f service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:20.508455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-43311d7d-8851-4557-ab94-175ff77e9527 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Action: 'create', calling method: .version_select at 0x7efe4f282af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564365452", "metadata": {"Type": "work"}}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-43311d7d-8851-4557-ab94-175ff77e9527 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Request method failure captured: Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 121 Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2zLXkDRezTLdFdU223OGEqHUwz_O1iZSqfNBOm0cQ0CxXZN99jPvbS_rQqwHPdP0sNfWooyqEGWBq4wCQfTfTvz2-ugwhRvZJhCvtTf7xWu1Ul1GMtSF250E9ebL5adpDvpFg2sKDTa705jGVkBYsgutNiGYts0ePv6GbhieUobEc Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:08:20.525823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5de18929c28840bcbf3986f790260c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 26218ea6a74e457893838e0cc1f1edb3 Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564365452", "metadata": {"Type": "work"}}} Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:08:20.527281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-564365452', 'metadata': {'Type': 'work'}}}} Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise error Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:08:20.529189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 12:08:20.531832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 12:08:20.533271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 12:08:20.533271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.542649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-43311d7d-8851-4557-ab94-175ff77e9527 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:08:20.542649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-43311d7d-8851-4557-ab94-175ff77e9527 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.549401 Aug 30 12:08:20.547938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 31/60] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Aug 30 12:08:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:08:20.548131 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-d0b39d7e-dd44-4140-bfb5-60966f47a237 req-13f95d6a-e35b-431b-ba0b-ad2deb2a4c4f service nova] Creating event network-changed:1a156fe5-05f5-48b0-bb53-3f8c98e5846a for instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc on hv-cinder-83976 Aug 30 12:08:20.553286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a477dad5-307c-47ea-b3e2-26f97714b257 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Action: 'create', calling method: .version_select at 0x7efe4f2a0940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633396768", "metadata": {"Type": "work"}}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a477dad5-307c-47ea-b3e2-26f97714b257 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Request method failure captured: Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 120 Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2zLXkDRezTLdFdU223OGEqHUwz_O1iZSqfNBOm0cQ0CxXZN99jPvbS_rQqwHPdP0sNfWooyqEGWBq4wCQfTfTvz2-ugwhRvZJhCvtTf7xWu1Ul1GMtSF250E9ebL5adpDvpFg2sKDTa705jGVkBYsgutNiGYts0ePv6GbhieUobEc Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:08:20.559251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5de18929c28840bcbf3986f790260c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 26218ea6a74e457893838e0cc1f1edb3 Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633396768", "metadata": {"Type": "work"}}} Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:08:20.561285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1633396768', 'metadata': {'Type': 'work'}}}} Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise error Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi '0' Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:08:20.561958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 12:08:20.563187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 12:08:20.565845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 12:08:20.565845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.565845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a477dad5-307c-47ea-b3e2-26f97714b257 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:08:20.566241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a477dad5-307c-47ea-b3e2-26f97714b257 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017007 Aug 30 12:08:20.571074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 32/61] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Aug 30 12:08:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 12:08:20.571311 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-d0b39d7e-dd44-4140-bfb5-60966f47a237 req-13f95d6a-e35b-431b-ba0b-ad2deb2a4c4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133450 Aug 30 12:08:20.576307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 30/62] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:20.579821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-217b6ec8-a81e-4190-964a-077d1cc379a6 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Action: 'create', calling method: .version_select at 0x7efe4f2e1a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1666026831", "metadata": {"Type": "work"}}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-217b6ec8-a81e-4190-964a-077d1cc379a6 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Request method failure captured: Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 119 Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2zLXkDRezTLdFdU223OGEqHUwz_O1iZSqfNBOm0cQ0CxXZN99jPvbS_rQqwHPdP0sNfWooyqEGWBq4wCQfTfTvz2-ugwhRvZJhCvtTf7xWu1Ul1GMtSF250E9ebL5adpDvpFg2sKDTa705jGVkBYsgutNiGYts0ePv6GbhieUobEc Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:08:20.593446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5de18929c28840bcbf3986f790260c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 26218ea6a74e457893838e0cc1f1edb3 Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1666026831", "metadata": {"Type": "work"}}} Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: Aug 30 12:08:20.594618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1666026831', 'metadata': {'Type': 'work'}}}} Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise error Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi '' Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:08:20.595272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 12:08:20.606082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 12:08:20.607293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 12:08:20.607293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.607293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-217b6ec8-a81e-4190-964a-077d1cc379a6 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:08:20.607293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-217b6ec8-a81e-4190-964a-077d1cc379a6 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021925 Aug 30 12:08:20.607293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 33/63] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Aug 30 12:08:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:08:20.609721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30553333-ee89-4bbf-a854-eea145393782 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Calling method '.version_select at 0x7efe4f34aca0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:20.620246 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=20 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:20.654867 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:20.655485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:20.658545 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-30553333-ee89-4bbf-a854-eea145393782 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] HTTP exception thrown: Volume tempest-invalid-699624450 could not be found. Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30553333-ee89-4bbf-a854-eea145393782 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Request method failure captured: Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-699624450 HTTP/1.1 Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2zLXkDRezTLdFdU223OGEqHUwz_O1iZSqfNBOm0cQ0CxXZN99jPvbS_rQqwHPdP0sNfWooyqEGWBq4wCQfTfTvz2-ugwhRvZJhCvtTf7xWu1Ul1GMtSF250E9ebL5adpDvpFg2sKDTa705jGVkBYsgutNiGYts0ePv6GbhieUobEc Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:08:20.662665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5de18929c28840bcbf3986f790260c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 26218ea6a74e457893838e0cc1f1edb3 Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Volume tempest-invalid-699624450 could not be found. Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'tempest-invalid-699624450'} Aug 30 12:08:20.664072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-699624450 could not be found. (HTTP 404) (Request-ID: req-e54d3ca4-432b-4bac-9341-fdd2e5fb568c) Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.664903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 12:08:20.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-699624450 could not be found. Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:08:20.668167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-699624450 could not be found. Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-699624450 could not be found. Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30553333-ee89-4bbf-a854-eea145393782 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Returning 404 to user: Volume tempest-invalid-699624450 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-30553333-ee89-4bbf-a854-eea145393782 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-699624450" status: 404 len: 98 microversion: 2.1 time: 0.062408 Aug 30 12:08:20.670051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 31/64] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Aug 30 12:08:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-699624450 => generated 98 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 12:08:20.673748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:20.677897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0615a03d-96fb-4eca-b508-4c9743a539a5 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008140 Aug 30 12:08:20.678834 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:20.679587 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:20.680433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:20.680904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:20.681393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:20.682494 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Aug 30 12:08:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 12:08:20.692699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-50530ff7-f899-4cc8-aa77-95081f84e25c tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009128 Aug 30 12:08:20.698903 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 33/66] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Aug 30 12:08:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 12:08:20.710603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1a8533b8-a08f-447e-a7f3-e292a7ddf483 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Calling method '.version_select at 0x7efe4f34a700>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:20.766139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-1a8533b8-a08f-447e-a7f3-e292a7ddf483 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] HTTP exception thrown: Volume c4a20271-4b71-41e1-9a97-4743fa967187 could not be found. Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1a8533b8-a08f-447e-a7f3-e292a7ddf483 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Request method failure captured: Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/os-volumes/c4a20271-4b71-41e1-9a97-4743fa967187 HTTP/1.1 Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2zLXkDRezTLdFdU223OGEqHUwz_O1iZSqfNBOm0cQ0CxXZN99jPvbS_rQqwHPdP0sNfWooyqEGWBq4wCQfTfTvz2-ugwhRvZJhCvtTf7xWu1Ul1GMtSF250E9ebL5adpDvpFg2sKDTa705jGVkBYsgutNiGYts0ePv6GbhieUobEc Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:08:20.770328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5de18929c28840bcbf3986f790260c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 26218ea6a74e457893838e0cc1f1edb3 Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Volume c4a20271-4b71-41e1-9a97-4743fa967187 could not be found. Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'c4a20271-4b71-41e1-9a97-4743fa967187'} Aug 30 12:08:20.771681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4a20271-4b71-41e1-9a97-4743fa967187 could not be found. (HTTP 404) (Request-ID: req-01001626-fbbf-4c28-85f5-4b764d67658e) Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.772518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 12:08:20.773700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4a20271-4b71-41e1-9a97-4743fa967187 could not be found. Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 12:08:20.774851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4a20271-4b71-41e1-9a97-4743fa967187 could not be found. Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4a20271-4b71-41e1-9a97-4743fa967187 could not be found. Aug 30 12:08:20.775777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.783399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1a8533b8-a08f-447e-a7f3-e292a7ddf483 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Returning 404 to user: Volume c4a20271-4b71-41e1-9a97-4743fa967187 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:08:20.783399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1a8533b8-a08f-447e-a7f3-e292a7ddf483 tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/c4a20271-4b71-41e1-9a97-4743fa967187" status: 404 len: 109 microversion: 2.1 time: 0.077754 Aug 30 12:08:20.783399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 34/67] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:08:20 2022] DELETE /compute/v2.1/os-volumes/c4a20271-4b71-41e1-9a97-4743fa967187 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:08:20.801572 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f62263e3-e994-4117-8836-2add81d3235c tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Calling method '.version_select at 0x7efe4f31ea60>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:20.881011 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-f62263e3-e994-4117-8836-2add81d3235c tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] HTTP exception thrown: Volume c43bd5db-d367-4026-b65a-f427fba61db1 could not be found. Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f62263e3-e994-4117-8836-2add81d3235c tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Request method failure captured: Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/os-volumes/c43bd5db-d367-4026-b65a-f427fba61db1 HTTP/1.1 Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2zLXkDRezTLdFdU223OGEqHUwz_O1iZSqfNBOm0cQ0CxXZN99jPvbS_rQqwHPdP0sNfWooyqEGWBq4wCQfTfTvz2-ugwhRvZJhCvtTf7xWu1Ul1GMtSF250E9ebL5adpDvpFg2sKDTa705jGVkBYsgutNiGYts0ePv6GbhieUobEc Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:08:20.882951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5de18929c28840bcbf3986f790260c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5de18929c28840bcbf3986f790260c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 5de18929c28840bcbf3986f790260c1c Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-VolumesNegativeTest-513146953 Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 26218ea6a74e457893838e0cc1f1edb3 Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-VolumesNegativeTest-513146953-project Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Volume c43bd5db-d367-4026-b65a-f427fba61db1 could not be found. Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'c43bd5db-d367-4026-b65a-f427fba61db1'} Aug 30 12:08:20.884081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c43bd5db-d367-4026-b65a-f427fba61db1 could not be found. (HTTP 404) (Request-ID: req-cce0baab-5e4a-4e15-98a3-076bc8e11184) Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.885049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 12:08:20.886098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c43bd5db-d367-4026-b65a-f427fba61db1 could not be found. Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 12:08:20.887000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c43bd5db-d367-4026-b65a-f427fba61db1 could not be found. Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c43bd5db-d367-4026-b65a-f427fba61db1 could not be found. Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f62263e3-e994-4117-8836-2add81d3235c tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] Returning 404 to user: Volume c43bd5db-d367-4026-b65a-f427fba61db1 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:08:20.887913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f62263e3-e994-4117-8836-2add81d3235c tempest-VolumesNegativeTest-513146953 tempest-VolumesNegativeTest-513146953-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c43bd5db-d367-4026-b65a-f427fba61db1" status: 404 len: 109 microversion: 2.1 time: 0.095001 Aug 30 12:08:20.895655 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 35/68] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:08:20 2022] GET /compute/v2.1/os-volumes/c43bd5db-d367-4026-b65a-f427fba61db1 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:08:20.926740 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:20.927596 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:20.941462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:20.942201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:20.943656 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:20.944812 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:20.947091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:20.947777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:20.968529 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:20.981254 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-29ac3d92-25ef-4c58-876f-de5e51585c5d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.331373 Aug 30 12:08:20.985495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:20 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:21.257019 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:21.266525 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:21.268883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:21.270061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-54af2806-7e0b-4631-92b4-721f06900af0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.347306 Aug 30 12:08:21.270677 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:20 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:21.456781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:21.457391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:21.463813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:21.464530 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:21.465138 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:21.465842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:21.466657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:21.467231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:21.660298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:21.670278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7ac1e259-f1f8-4010-a4a7-9d602168f5c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.217589 Aug 30 12:08:21.671087 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 35/71] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:21 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:22.007814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:22.008467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:22.015280 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:22.015770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:22.016230 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:22.016921 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:22.017373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:22.017788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:22.167354 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:22.176521 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dcef3298-894f-4f46-a5ab-3ded17d6d588 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.172368 Aug 30 12:08:22.186383 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 37/72] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:22 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:22.293643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:22.295821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:22.302625 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:22.303779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:22.304439 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:22.305222 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:22.305939 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:22.306519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:22.499780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:22.512397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:22.516478 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:22.520522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a9577bb2-ee69-482a-bd39-523d9d5f3d50 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.230100 Aug 30 12:08:22.523999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 36/73] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:22 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:22.725301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:22.725301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:22.725301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:22.725301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:22.725741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:22.725741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:22.725741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:22.725741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:22.726079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:22.876782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:22.891922 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-045c3589-7aa1-431e-9dbd-dccb681aa359 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.204756 Aug 30 12:08:22.892868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 38/74] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:22 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:23.196595 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:23.197058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:23.203849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:23.204537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:23.204979 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:23.205671 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:23.206278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:23.206696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:23.342855 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:23.351304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-51eda855-d54a-458e-a32b-054f3eacab8c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.158645 Aug 30 12:08:23.352728 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 37/75] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:23 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:23.546104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:23.546719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:23.553308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:23.553686 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:23.554114 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:23.554805 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:23.555254 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:23.555675 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:23.575003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:23.710898 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:23.719669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:23.721158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:23.722551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4853b33b-4f91-4dd0-b56d-a9c953802bf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.180540 Aug 30 12:08:23.723224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:23 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:23.914910 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:23.915436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:23.921607 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:23.922079 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:23.922502 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:23.923177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:23.923625 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:23.924063 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:23.929639 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:24.056447 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:24.065488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3fafafcd-6374-4646-b9fe-1d6dccc7110a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.154098 Aug 30 12:08:24.065488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 38/77] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:23 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:24.373381 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:24.374369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:24.389612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:24.390435 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:24.391191 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:24.397128 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:24.398160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:24.398799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:24.582337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:24.590127 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-17cb9deb-4aea-4bc7-871a-7985557faf1a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.221762 Aug 30 12:08:24.590700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 40/78] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:24 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:24.747092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:24.748585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:24.755508 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:24.756013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:24.756448 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:24.757178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:24.757562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:24.757980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:24.898395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:24.907005 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:24.908621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:24.909776 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f9a6ea25-6554-4456-827e-fd7706963857 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.166520 Aug 30 12:08:24.910338 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 39/79] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:24 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:25.085749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:25.086446 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:25.093099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:25.093657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:25.094163 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:25.094925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:25.095385 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:25.095880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:25.246659 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:25.255780 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8f08f4dc-e509-465f-abb5-886e3cd4749b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.173789 Aug 30 12:08:25.256361 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 41/80] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:25 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:25.612139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:25.612781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:25.618797 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:25.619396 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:25.619860 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:25.620638 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:25.621091 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:25.621884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:25.825356 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:25.835812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-38a901b8-f6fa-403a-b924-7c5a6b79249d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.228937 Aug 30 12:08:25.836465 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 40/81] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:25 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:25.933113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:25.933714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:25.946453 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:25.948014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:25.948566 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:25.948991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:25.954156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:25.954758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:25.955206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:26.175545 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:26.191093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:26.196633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:26.198014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5dd92b12-f498-4a04-bf58-1e166ca50de3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.269191 Aug 30 12:08:26.201944 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 42/82] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:25 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:26.278200 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:26.279326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:26.308607 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:26.312361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:26.313418 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:26.315887 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:26.316926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:26.319486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:26.531367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:26.542185 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8dae611a-02b3-48fb-9721-12890e1e4126 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.269412 Aug 30 12:08:26.543501 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 41/83] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:26 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:26.859836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:26.860740 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:26.878756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:26.878756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:26.878756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:26.878756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:26.880970 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:26.880970 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:27.061556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:27.075455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-37198fad-8c0b-4e4a-95d2-69f7d6601167 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.219781 Aug 30 12:08:27.076228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:26 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:27.224198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:27.225370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:27.232738 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=6 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:27.234732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:27.235665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:27.236420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:27.237186 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:27.237699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:27.238378 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:27.420280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:27.429032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:27.430463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:27.431557 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4cd38af1-8454-4add-9e36-9714b674fd0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.212710 Aug 30 12:08:27.432197 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 42/85] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:27 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:27.565160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:27.566125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:27.572663 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:27.578406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:27.578406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:27.578406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:27.578406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:27.579039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:27.735637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:27.750758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bfdcba71-f2de-44ac-b68f-f5d622aa6599 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.189519 Aug 30 12:08:27.752208 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 44/86] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:27 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:28.160769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:28.160769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:28.160769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:28.160769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:28.161542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:28.161542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:28.161542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:28.161542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:28.348302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:28.365835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9016416c-5376-401a-9f62-8cc86d170a2b tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.271687 Aug 30 12:08:28.375981 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 43/87] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:28 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:28.457398 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:28.458030 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:28.463581 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:28.466707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:28.467384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:28.468084 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:28.468967 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:28.469623 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:28.470231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:28.560626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-a36c5bda-bd06-40b9-a6c6-0f38fa2ae72d req-37225f73-d75b-4a7b-9f6f-7ef30cad0771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10ec061-4640-4100-bc70-536c1e6f263c", "name": "network-vif-plugged", "status": "completed", "tag": "397487c0-c694-4ca4-832b-a518e277191a"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:28.573938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-a36c5bda-bd06-40b9-a6c6-0f38fa2ae72d req-37225f73-d75b-4a7b-9f6f-7ef30cad0771 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:28.574607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-a36c5bda-bd06-40b9-a6c6-0f38fa2ae72d req-37225f73-d75b-4a7b-9f6f-7ef30cad0771 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:28.575824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-a36c5bda-bd06-40b9-a6c6-0f38fa2ae72d req-37225f73-d75b-4a7b-9f6f-7ef30cad0771 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:28.601332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-a36c5bda-bd06-40b9-a6c6-0f38fa2ae72d req-37225f73-d75b-4a7b-9f6f-7ef30cad0771 service nova] Creating event network-vif-plugged:397487c0-c694-4ca4-832b-a518e277191a for instance f10ec061-4640-4100-bc70-536c1e6f263c on hv-cinder-83976 Aug 30 12:08:28.608033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-a36c5bda-bd06-40b9-a6c6-0f38fa2ae72d req-37225f73-d75b-4a7b-9f6f-7ef30cad0771 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223994 Aug 30 12:08:28.609017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 45/88] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:28.648501 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:28.657694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:28.659381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:28.660777 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-38dc6309-0b6d-4f70-8a2c-8435038c8f5e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.208194 Aug 30 12:08:28.661854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 44/89] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:28 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:08:28.773402 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:28.774092 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:28.780452 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:28.780926 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:28.781352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:28.782030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:28.782474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:28.782887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:28.922580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:28.930158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ebf2742f-64de-4a50-b0b3-f50cd4a6c6f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.161096 Aug 30 12:08:28.930721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 46/90] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:28 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:29.390650 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:29.391455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:29.398703 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:29.399280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:29.399823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:29.400870 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:29.401496 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:29.401971 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:29.591656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:29.601873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c6eb0561-a2a8-4f7b-a414-2d8ceb0e9717 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.216699 Aug 30 12:08:29.615450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 45/91] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:29 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:29.693764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:29.694801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:29.709283 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:29.709283 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:29.709283 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:29.709982 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:29.710604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:29.711424 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:29.871815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:29.881276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:29.882729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:29.886209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-41bdff81-b485-4a5d-86af-8c204ca9b51e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.199599 Aug 30 12:08:29.886771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 47/92] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:29 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:29.952662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:29.953435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:29.961826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:29.962544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:29.963156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:29.963861 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:29.964342 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:29.964859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:30.113378 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:30.125332 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6b335795-8dff-4f47-993e-253f98ed0982 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.177338 Aug 30 12:08:30.126146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 46/93] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:29 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:30.622888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:30.623767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:30.632951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:30.633730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:30.634906 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:30.636100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:30.637911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:30.638522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:30.818797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:30.837146 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d7ae498e-6ef4-448f-b06e-0f8bad8f46df tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.218443 Aug 30 12:08:30.838131 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 48/94] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:30 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:30.910401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:30.915438 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:30.917007 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:30.917470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:30.917894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:30.918579 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:30.919093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:30.919515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:31.051460 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:31.062757 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:31.064009 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:31.065304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c8ca7177-4f38-4f78-9887-176c60fb9e0e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.159070 Aug 30 12:08:31.065940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 47/95] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:30 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:31.146640 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:31.147364 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:31.155565 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:31.156082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:31.156519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:31.159071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:31.159071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:31.159071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:31.291439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:31.299811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-de3b5e6e-1d1e-4233-ab08-c4c972ebc732 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.157127 Aug 30 12:08:31.300411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 49/96] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:31 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:31.859110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:31.859780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:31.865941 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:31.867182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:31.867834 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:31.868564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:31.869022 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:31.869442 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:32.074355 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:32.083374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3f5b0aac-7f67-4be4-add8-08d62dcf175a tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.228390 Aug 30 12:08:32.089310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:32.091064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:32.094818 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 48/97] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:31 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:32.098676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:32.099160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:32.099591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:32.100309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:32.100760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:32.101179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:32.283045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-2077b854-ca3e-48e1-ad19-cd39fcdfd1d3 req-37e9c0ee-b574-4c12-9417-5bbe19325b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294a2d1c-a5ff-4f5e-945f-03a42a7800cc", "name": "network-vif-plugged", "status": "completed", "tag": "1a156fe5-05f5-48b0-bb53-3f8c98e5846a"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:32.285744 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:32.293418 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2077b854-ca3e-48e1-ad19-cd39fcdfd1d3 req-37e9c0ee-b574-4c12-9417-5bbe19325b8c service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:32.294712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2077b854-ca3e-48e1-ad19-cd39fcdfd1d3 req-37e9c0ee-b574-4c12-9417-5bbe19325b8c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:32.294918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:32.295220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2077b854-ca3e-48e1-ad19-cd39fcdfd1d3 req-37e9c0ee-b574-4c12-9417-5bbe19325b8c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:32.297199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:32.298302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4b0b719c-609d-4870-bd02-6b846ca84551 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.212896 Aug 30 12:08:32.298864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 50/98] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:32 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:32.313489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-2077b854-ca3e-48e1-ad19-cd39fcdfd1d3 req-37e9c0ee-b574-4c12-9417-5bbe19325b8c service nova] Creating event network-vif-plugged:1a156fe5-05f5-48b0-bb53-3f8c98e5846a for instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc on hv-cinder-83976 Aug 30 12:08:32.318708 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-2077b854-ca3e-48e1-ad19-cd39fcdfd1d3 req-37e9c0ee-b574-4c12-9417-5bbe19325b8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039296 Aug 30 12:08:32.319505 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 49/99] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:32.321643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:32.322295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:32.328895 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:32.329375 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:32.330356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:32.330503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:32.330911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:32.331331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:32.484160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:32.492330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a8e19c65-3e71-45d6-9081-8a6deb17d7f3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.174633 Aug 30 12:08:32.506698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 51/100] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:32 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:33.105716 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:33.107091 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:33.120092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:33.120720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:33.121223 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:33.122044 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:33.122965 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:33.123458 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:33.304681 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:33.317656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8ff07805-924d-4742-9c9e-fc9b53a5b200 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.216021 Aug 30 12:08:33.318453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:33 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:33.322258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:33.327844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:33.334171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:33.334662 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:33.335125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:33.335905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:33.336412 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:33.336807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:33.492116 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:33.507591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:33.513491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:33.515002 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e80878e4-d1b7-407e-be02-392c6cbfed6a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1408 microversion: 2.20 time: 0.198161 Aug 30 12:08:33.516072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 52/102] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:33 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:33.523192 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:33.525191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:33.532752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:33.533249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:33.533772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:33.534511 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:33.534969 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:33.535387 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:33.678637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:33.687994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-70d98a5e-d3cb-4313-9a25-31d17405e820 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.176331 Aug 30 12:08:33.693236 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 51/103] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:33 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:34.339403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-d7455d80-4a08-4fd1-8fa8-3bea2b4d94fb req-dc45caf0-a77e-419f-8b21-4bab47761322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce796eb4-8b4c-4bfd-9192-af2720e5ffe7", "name": "network-vif-plugged", "status": "completed", "tag": "9cc8c7f0-1c17-42d8-8435-61b13a40d2d0"}, {"server_uuid": "393867e8-3598-4477-a515-e0e91f5ff5df", "name": "network-vif-plugged", "status": "completed", "tag": "bd985017-5118-4030-bf51-25ac4f9eb763"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:34.342923 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:34.343532 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:34.350504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.351157 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.351815 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.352676 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.353271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.353878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.356935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d7455d80-4a08-4fd1-8fa8-3bea2b4d94fb req-dc45caf0-a77e-419f-8b21-4bab47761322 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.362151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d7455d80-4a08-4fd1-8fa8-3bea2b4d94fb req-dc45caf0-a77e-419f-8b21-4bab47761322 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.362151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d7455d80-4a08-4fd1-8fa8-3bea2b4d94fb req-dc45caf0-a77e-419f-8b21-4bab47761322 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.372683 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-d7455d80-4a08-4fd1-8fa8-3bea2b4d94fb req-dc45caf0-a77e-419f-8b21-4bab47761322 service nova] Creating event network-vif-plugged:9cc8c7f0-1c17-42d8-8435-61b13a40d2d0 for instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 on hv-cinder-83976 Aug 30 12:08:34.373490 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-d7455d80-4a08-4fd1-8fa8-3bea2b4d94fb req-dc45caf0-a77e-419f-8b21-4bab47761322 service nova] Creating event network-vif-plugged:bd985017-5118-4030-bf51-25ac4f9eb763 for instance 393867e8-3598-4477-a515-e0e91f5ff5df on hv-cinder-83976 Aug 30 12:08:34.381004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-d7455d80-4a08-4fd1-8fa8-3bea2b4d94fb req-dc45caf0-a77e-419f-8b21-4bab47761322 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045889 Aug 30 12:08:34.381929 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 53/104] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:34.500643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:34.509294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9ce60234-383b-4cf3-ab4f-66a30142c783 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.171267 Aug 30 12:08:34.509929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 52/105] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:34 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:34.540107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:34.540808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:34.548343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.548832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.549268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.549962 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.550511 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.550835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.726792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:34.727883 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:34.737826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.738734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.739421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.740497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.741239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.742183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.770883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:34.782256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:34.783816 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:34.785441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3f519c91-8221-40bc-9990-0f197bcbb4be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1599 microversion: 2.20 time: 0.250397 Aug 30 12:08:34.786303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 54/106] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:08:34 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1599 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:08:34.808759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:34.809791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:34.815779 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.816303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.816735 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.817428 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:34.817881 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:34.818321 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:34.929564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:34.941667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-da9cb2a6-9f46-42b8-9210-c2367978e633 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.226808 Aug 30 12:08:34.942240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:34 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:35.026905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a09bb224-4810-47c2-8daf-f604128459a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.222147 Aug 30 12:08:35.036454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 55/108] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Aug 30 12:08:34 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:08:35.531198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:35.531999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:35.537989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:35.538471 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:35.539480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:35.539752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:35.540251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:35.540663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:35.826366 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:35.836642 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1b6f97d9-92c6-41fe-a72c-178bc86cdfaf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.309632 Aug 30 12:08:35.837510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 54/109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:35 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:35.964160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:35.964702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:35.974753 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:35.975310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:35.975824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:35.976770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:35.977422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:35.978131 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:36.228764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:36.239298 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a3c29e5a-2e07-43dc-a988-4ab2c7cfc67d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1319 microversion: 2.1 time: 0.279759 Aug 30 12:08:36.241955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 56/110] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:35 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:36.848781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-3815c6d3-982b-42df-8355-023ede143b7b req-39c71a49-7e9b-427e-b4af-73e9b51b5072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294a2d1c-a5ff-4f5e-945f-03a42a7800cc", "tag": "1a156fe5-05f5-48b0-bb53-3f8c98e5846a"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:36.863503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:36.863503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:36.870291 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-3815c6d3-982b-42df-8355-023ede143b7b req-39c71a49-7e9b-427e-b4af-73e9b51b5072 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:36.872654 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-3815c6d3-982b-42df-8355-023ede143b7b req-39c71a49-7e9b-427e-b4af-73e9b51b5072 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:36.874755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-3815c6d3-982b-42df-8355-023ede143b7b req-39c71a49-7e9b-427e-b4af-73e9b51b5072 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:36.907734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:36.911327 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:36.914515 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:36.916393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:36.919104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-3815c6d3-982b-42df-8355-023ede143b7b req-39c71a49-7e9b-427e-b4af-73e9b51b5072 service nova] Creating event network-changed:1a156fe5-05f5-48b0-bb53-3f8c98e5846a for instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc on hv-cinder-83976 Aug 30 12:08:36.919994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:36.920434 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:36.930626 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-3815c6d3-982b-42df-8355-023ede143b7b req-39c71a49-7e9b-427e-b4af-73e9b51b5072 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085504 Aug 30 12:08:36.936209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 55/111] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:37.108803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:37.112784 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:37.117836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1b72652e-051b-4ed5-94eb-973279bbc6cf tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1314 microversion: 2.1 time: 0.259923 Aug 30 12:08:37.120083 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:36 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:37.264615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:37.265306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:37.275221 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:37.282395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:37.282856 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:37.283799 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:37.284440 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:37.286664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:37.300581 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:37.547410 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:37.556510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ff71692d-94aa-4f14-be84-037aff13eb8c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1513 microversion: 2.1 time: 0.298478 Aug 30 12:08:37.557307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 56/113] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:37 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:37.587134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:37.609594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:37.628988 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:37.629765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:37.630861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:37.631566 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:37.632038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:37.633366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:37.696520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lazy-loading 'flavor' on Instance uuid 393867e8-3598-4477-a515-e0e91f5ff5df {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:08:38.000303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7593b056-f660-4fc6-8b0c-6bbb73190c30 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df/action" status: 200 len: 32 microversion: 2.1 time: 0.419357 Aug 30 12:08:38.001037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 58/114] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:08:37 2022] POST /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:08:38.016576 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:38.021012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:38.035245 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:38.035524 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:38.036019 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:38.036755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:38.037694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:38.038370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:38.142464 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:38.143178 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:38.149593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:38.150078 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:38.150520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:38.151273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:38.151932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:38.153599 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:38.227641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:38.238786 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8d77ab5f-fc36-4b3e-8686-5f7e64fe5a1b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.231144 Aug 30 12:08:38.240477 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 57/115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:38 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:38.363611 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:38.399323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-42c94fdb-e160-4bf5-9131-c435789d6468 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1501 microversion: 2.1 time: 0.256435 Aug 30 12:08:38.399323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 59/116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:38 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:39.263503 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:39.265074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:39.316305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:39.317083 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:39.317733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:39.318911 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:39.319870 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:39.320835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:39.656609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:39.673707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b70d0995-5779-4401-a832-bcaf614931d3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.415358 Aug 30 12:08:39.692773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 58/117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:39 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:40.450378 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59c55560-d76c-426d-b39e-4920dfcac122"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:40.454606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:40.461075 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:40.461716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:40.462322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:40.463288 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:40.463731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:40.464214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:40.700118 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:40.701495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:40.707624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:40.708229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:40.708729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:40.709486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:40.710095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:40.710513 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:40.863047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:40.871122 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-436abf1a-bb1d-46bb-bf48-6fb3a70e7e21 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.175201 Aug 30 12:08:40.876303 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 59/118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:40 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:41.436859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9a0942e8-1ced-4dd8-92f1-3bf632ddacd9 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "POST /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994742 Aug 30 12:08:41.437552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 60/119] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:08:40 2022] POST /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:08:41.892904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:41.893507 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:41.899864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:41.900379 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:41.900835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:41.901542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:41.902030 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:41.902462 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:42.040611 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:42.049117 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ef8e6c4a-5f89-4110-9bee-3ff68a129134 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.160699 Aug 30 12:08:42.049656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 60/120] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:41 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:43.072291 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:43.072989 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:43.080170 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:43.080659 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:43.081085 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:43.081767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:43.082209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:43.082617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:43.228791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:43.237430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f3ccd67a-ecdd-459e-9c7b-68cb6f6094af tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.170198 Aug 30 12:08:43.237996 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 61/121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:43 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:44.269711 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:44.273808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:44.280999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:44.281482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:44.281917 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:44.282604 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:44.283053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:44.283548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:44.443649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:44.455564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-542ce074-77e5-4f0e-a9b4-455aa2edee54 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.189638 Aug 30 12:08:44.456178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 61/122] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:44 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:45.484353 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:45.485114 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:45.491607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:45.493647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:45.493647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:45.493647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:45.494088 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:45.494214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:45.630450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:45.644987 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4de0927e-01a2-40aa-9a0e-a6d6020f3830 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.165841 Aug 30 12:08:45.645565 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 62/123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:45 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:46.667140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:46.667825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:46.674433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:46.674907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:46.675331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:46.676046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:46.676489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:46.676946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:46.822594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:46.830564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-90a8dddd-e189-4e6f-8ebd-7e386410b8fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.167500 Aug 30 12:08:46.831139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 62/124] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:46 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:47.852997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:47.853692 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:47.861101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:47.861763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:47.862196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:47.862880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:47.863324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:47.863738 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:48.008745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:48.016830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bbf4e669-2829-428a-8443-1d4c03269c94 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.167858 Aug 30 12:08:48.017575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 63/125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:47 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:49.038397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:49.039004 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:49.044921 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:49.046068 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:49.046734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:49.047422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:49.047953 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:49.048381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:49.257179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:49.265686 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5a049946-93e5-4932-8526-b165a30e16e7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.231209 Aug 30 12:08:49.266318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 63/126] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:49 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:50.286887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:50.287463 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:50.294026 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:50.294506 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:50.294951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:50.295655 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:50.296138 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:50.296554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:50.438114 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:50.445796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f1e7e6a8-d2f1-4756-885a-bb79c37a1b41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.162937 Aug 30 12:08:50.446366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 64/127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:50 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:51.466416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:51.467576 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:51.473854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:51.474321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:51.474740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:51.475534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:51.476003 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:51.476416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:51.645840 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:51.654291 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2473740e-eb87-4e72-875f-10fe07777fbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.191598 Aug 30 12:08:51.655790 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 64/128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:51 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:52.676721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:52.677603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:52.686618 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:52.686618 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:52.686618 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:52.686618 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:52.689067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:52.690486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:52.837845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:52.846388 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cb83ea63-7315-4600-8ddb-e197235ab50b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.173483 Aug 30 12:08:52.847218 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 65/129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:52 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:53.867771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:53.868431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:53.875443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:53.875925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:53.876395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:53.877101 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:53.877570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:53.877982 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:54.038488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:54.049170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b47543bc-7772-4f39-b490-d4fa84f0c29f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.185188 Aug 30 12:08:54.071256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 65/130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:53 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:54.923777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:54.924935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:54.936350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:54.936350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:54.936350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:54.936350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:54.936671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:54.936671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:54.970017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:08:55.077689 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:55.078951 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:55.086146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:55.086696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:55.087176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:55.088060 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:55.088618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:55.088981 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:55.305976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:55.311964 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0f0e1907-ed3a-4caa-8dcd-ae5dcd5854a7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.238355 Aug 30 12:08:55.314104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8c6a2282-e1dd-40c7-8119-871011dcf171 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 204 len: 0 microversion: 2.1 time: 0.394951 Aug 30 12:08:55.315545 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 66/131] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:08:54 2022] DELETE /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:08:55.316111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 66/132] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:55 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:55.324256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:55.325248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:55.333764 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:55.334328 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:55.334824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:55.335521 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:55.346316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:55.346316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:55.502321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:55.511132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c9237fdf-0e87-41c6-92c2-71df00251ee1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1553 microversion: 2.1 time: 0.191389 Aug 30 12:08:55.511802 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 67/133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:55 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:56.338101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:56.338817 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:56.347060 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:56.347537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:56.347983 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:56.348726 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:56.349175 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:56.349590 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:56.487109 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:56.494967 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5536cfc9-be75-43ac-9f1e-50328c3f652d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.161525 Aug 30 12:08:56.495556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 67/134] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:56 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:56.532893 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:56.533592 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:56.539523 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:56.540054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:56.540474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:56.541150 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:56.541593 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:56.542006 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:56.680824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:56.690167 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-08159f98-40d0-40d9-838a-d40c3422c39c tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1553 microversion: 2.1 time: 0.161492 Aug 30 12:08:56.690744 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 68/135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:56 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:57.517332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:57.517929 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:57.520303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:57.524949 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:57.525421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:57.527348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:57.527348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:57.527348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:57.527628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:57.697956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:57.708258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6d9faed8-99da-42d6-80ce-0ea656cd1f13 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.195176 Aug 30 12:08:57.708829 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 68/136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:57 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:57.719558 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:57.720581 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:57.728280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:57.729329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:57.730087 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:57.731182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:57.731820 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:57.732584 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:57.882602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:57.893056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dfad0c2b-3c93-4480-a185-17a55037fbce tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1553 microversion: 2.1 time: 0.185522 Aug 30 12:08:57.894464 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 69/137] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:57 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:08:58.729680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:58.730290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:58.738665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:58.739152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:58.739586 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:58.740310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:58.740770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:58.741188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:58.759812 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:08:58.915289 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:08:58.916716 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:08:58.927470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:58.928274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:58.928850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:58.929689 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:58.930375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:58.930943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:59.011212 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:59.025224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dd9ae41c-1876-47ff-9674-171be5b3a2f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.299454 Aug 30 12:08:59.026572 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 69/138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:58 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:59.112067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:08:59.122676 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ef64193e-fa32-4c97-a60c-400e8a6abf7e tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1553 microversion: 2.1 time: 0.211660 Aug 30 12:08:59.123665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 70/139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:08:58 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:08:59.466336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-d034df63-4539-44f6-8449-97a22b4fc9ae req-1dcd15bb-340c-41e9-9dee-4bae9a661554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce796eb4-8b4c-4bfd-9192-af2720e5ffe7", "name": "network-vif-deleted", "tag": "9cc8c7f0-1c17-42d8-8435-61b13a40d2d0"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:08:59.496923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d034df63-4539-44f6-8449-97a22b4fc9ae req-1dcd15bb-340c-41e9-9dee-4bae9a661554 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:08:59.497592 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d034df63-4539-44f6-8449-97a22b4fc9ae req-1dcd15bb-340c-41e9-9dee-4bae9a661554 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:08:59.498266 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d034df63-4539-44f6-8449-97a22b4fc9ae req-1dcd15bb-340c-41e9-9dee-4bae9a661554 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:08:59.515418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-d034df63-4539-44f6-8449-97a22b4fc9ae req-1dcd15bb-340c-41e9-9dee-4bae9a661554 service nova] Creating event network-vif-deleted:9cc8c7f0-1c17-42d8-8435-61b13a40d2d0 for instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 on hv-cinder-83976 Aug 30 12:08:59.520994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-d034df63-4539-44f6-8449-97a22b4fc9ae req-1dcd15bb-340c-41e9-9dee-4bae9a661554 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065020 Aug 30 12:08:59.522512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 70/140] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:09:00.055908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:00.056590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:00.062527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:00.063006 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:00.063463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:00.064647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:00.064776 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:00.065164 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:00.146814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:00.148360 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:00.155833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:00.156352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:00.156802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:00.158671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:00.159314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:00.160356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:00.206301 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:00.214178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f56d5dd3-d6b2-4cff-8e89-ed1b90843321 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.162156 Aug 30 12:09:00.214740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 71/141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:00 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:00.228601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:00.236955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-14c5870e-2117-4a09-b991-56fc8ecdc6f1 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1345 microversion: 2.1 time: 0.095240 Aug 30 12:09:00.237532 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 71/142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:00 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:01.235124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:01.235731 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:01.237646 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=55 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:01.242985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:01.243471 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:01.243968 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:01.244656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:01.245099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:01.245510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:01.258971 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:01.259666 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:01.267770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:01.268334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:01.268953 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:01.269699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:01.270708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:01.271194 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:01.327003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:01.327907 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:01.328652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:01.329531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lazy-loading 'fault' on Instance uuid ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:09:01.382806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:01.391620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-32ef95ee-15e1-4a98-880c-7a5de33d7850 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1350 microversion: 2.1 time: 0.136936 Aug 30 12:09:01.393801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 72/143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:01 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:01.436745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:01.440841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:01.445373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3b6e736e-9923-4c1c-afa3-1c7f758bca4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.214180 Aug 30 12:09:01.445940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 72/144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:01 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:02.414430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:02.415060 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:02.421482 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:02.421954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:02.422381 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:02.423202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:02.423660 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:02.424133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:02.455005 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:02.455471 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:02.455895 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:02.456355 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lazy-loading 'fault' on Instance uuid ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:09:02.466511 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:02.467113 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:02.478297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:02.478788 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:02.479215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:02.479928 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:02.480396 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:02.480813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:02.495307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:02.505110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6fc49bf6-2289-4fe2-9de2-3acf5aa8db2d tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1350 microversion: 2.1 time: 0.094503 Aug 30 12:09:02.505746 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 73/145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:02 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:02.616573 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:02.624104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-17ced7c6-123a-4cfa-a7dc-34e97c02a767 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.161453 Aug 30 12:09:02.624655 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 73/146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:02 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:03.526459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:03.527186 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:03.534793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:03.538061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:03.538061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:03.538061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:03.538061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:03.538395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:03.567211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:03.567694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:03.568166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:03.568612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lazy-loading 'fault' on Instance uuid ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:09:03.611010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f34590de854fd1aba73ae1b62de162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b44a4c6542f4a0ec957c371f4cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:03.619063 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-55f2ed90-a5e7-4dfb-9051-442623e88dde tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 200 len: 1350 microversion: 2.1 time: 0.097196 Aug 30 12:09:03.619626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 74/147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:03 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:03.646156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:03.646789 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:03.652960 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:03.653436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:03.653857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:03.654812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:03.655380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:03.655882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:03.788212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:03.795848 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-31268294-0cdd-4119-bb9a-e9a4a4c63623 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.155050 Aug 30 12:09:03.796427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 74/148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:03 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:04.639470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:04.640209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:04.646707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:04.647182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:04.647632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:04.648406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:04.648853 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:04.649265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:04.663559 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] HTTP exception thrown: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Request method failure captured: Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 HTTP/1.1 Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2hut2p29ezYJFNy_2b3z4W7xrBPPd0kTBlnxVH2yNi-XSJ0jrQhNN5HcNSnIXnLiubkaJmqMhhbr12teLQiBJ8aKLlbZjSd_mTsOlr4x0h19A0L-fSXuzjDDIffywAHzysoiZH29f2CUSnqNJP7PDgVSYJfyyu2yIHBLTmbC6_U28 Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:09:04.668164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: d9f34590de854fd1aba73ae1b62de162 Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.669617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'ce796eb4-8b4c-4bfd-9192-af2720e5ffe7'} Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:09:04.670474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.672004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.674259 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Returning 404 to user: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:09:04.674259 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-884d4669-a27d-4c15-9c30-e429d2bea767 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 404 len: 111 microversion: 2.1 time: 0.033953 Aug 30 12:09:04.674259 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 75/149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:04 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:09:04.793241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:04.795440 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:04.802236 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:04.802715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:04.803144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:04.803867 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:04.804346 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:04.809754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:04.817695 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:04.818380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:04.824447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:04.824917 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:04.835980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:04.835980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:04.835980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:04.835980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:04.854646 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] HTTP exception thrown: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Request method failure captured: Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7/os-volume_attachments HTTP/1.1 Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2hut2p29ezYJFNy_2b3z4W7xrBPPd0kTBlnxVH2yNi-XSJ0jrQhNN5HcNSnIXnLiubkaJmqMhhbr12teLQiBJ8aKLlbZjSd_mTsOlr4x0h19A0L-fSXuzjDDIffywAHzysoiZH29f2CUSnqNJP7PDgVSYJfyyu2yIHBLTmbC6_U28 Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:09:04.858906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: d9f34590de854fd1aba73ae1b62de162 Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.861217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'server_id': 'ce796eb4-8b4c-4bfd-9192-af2720e5ffe7'} Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:09:04.861961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:04.863213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:09:04.865181 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Returning 404 to user: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:09:04.865181 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-603e66e5-ccb8-4ef0-84c0-b56c06d8af23 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071833 Aug 30 12:09:04.865181 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 75/150] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:09:04 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7/os-volume_attachments => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:09:04.964326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:04.973580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b4822892-574e-4dee-8326-c88b3210cb9c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.159818 Aug 30 12:09:04.974154 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 76/151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:04 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:05.995915 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:05.996823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:06.002975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:06.003453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:06.003879 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:06.004582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:06.005023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:06.005436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:06.187714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:06.189612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:06.200548 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:06.201869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:06.201869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:06.202297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:06.202744 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:06.203168 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:06.217852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] HTTP exception thrown: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Request method failure captured: Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 HTTP/1.1 Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2hut2p29ezYJFNy_2b3z4W7xrBPPd0kTBlnxVH2yNi-XSJ0jrQhNN5HcNSnIXnLiubkaJmqMhhbr12teLQiBJ8aKLlbZjSd_mTsOlr4x0h19A0L-fSXuzjDDIffywAHzysoiZH29f2CUSnqNJP7PDgVSYJfyyu2yIHBLTmbC6_U28 Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:09:06.219550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: d9f34590de854fd1aba73ae1b62de162 Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.221179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'ce796eb4-8b4c-4bfd-9192-af2720e5ffe7'} Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:09:06.222140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.223279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.230728 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Returning 404 to user: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:09:06.230824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:06.230927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d5f3b19c-9f0c-47b7-8bcd-04c38fdfd4db tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 404 len: 111 microversion: 2.1 time: 0.037174 Aug 30 12:09:06.230927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 77/152] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:09:06 2022] DELETE /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 12:09:06.231104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e08c4e2e-c8ea-4823-ba8a-afe2d2e28f8b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.237669 Aug 30 12:09:06.231104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 76/153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:05 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:06.240574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:06.241185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] [instance: ce796eb4-8b4c-4bfd-9192-af2720e5ffe7] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:06.247289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:06.247846 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:06.248397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:06.249079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:06.249582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:06.249941 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:06.264573 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] HTTP exception thrown: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Request method failure captured: Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 HTTP/1.1 Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2hut2p29ezYJFNy_2b3z4W7xrBPPd0kTBlnxVH2yNi-XSJ0jrQhNN5HcNSnIXnLiubkaJmqMhhbr12teLQiBJ8aKLlbZjSd_mTsOlr4x0h19A0L-fSXuzjDDIffywAHzysoiZH29f2CUSnqNJP7PDgVSYJfyyu2yIHBLTmbC6_U28 Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:09:06.266731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5608b44a4c6542f4a0ec957c371f4cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 5608b44a4c6542f4a0ec957c371f4cc9 Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-DeleteServersTestJSON-258801601 Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: d9f34590de854fd1aba73ae1b62de162 Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-DeleteServersTestJSON-258801601-project Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.268631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'ce796eb4-8b4c-4bfd-9192-af2720e5ffe7'} Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:09:06.269403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. Aug 30 12:09:06.271160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:09:06.274091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] Returning 404 to user: Instance ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:09:06.274091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-27d1ddd0-9c71-4d14-8d76-a20cab6a5547 tempest-DeleteServersTestJSON-258801601 tempest-DeleteServersTestJSON-258801601-project] 10.222.0.42 "GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7" status: 404 len: 111 microversion: 2.1 time: 0.031957 Aug 30 12:09:06.274091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 78/154] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:06 2022] GET /compute/v2.1/servers/ce796eb4-8b4c-4bfd-9192-af2720e5ffe7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 12:09:07.252710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:07.253699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:07.262089 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:07.262696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:07.263195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:07.263979 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:07.264502 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:07.265023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:07.421933 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:07.433067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-deee77e8-9afc-4dfa-963d-e23cd088fe3e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.186183 Aug 30 12:09:07.434015 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 77/155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:07 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:08.469920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:08.471061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:08.484545 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:08.487347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:08.489302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:08.490263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:08.492620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:08.493067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:08.758918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:08.777259 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d1cca8db-e9ba-4fff-9d85-247c09196abc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.321725 Aug 30 12:09:08.787223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 79/156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:08 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:09.799254 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:09.799847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:09.822427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:09.822925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:09.823355 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:09.824261 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:09.825577 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:09.825982 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:10.183841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:10.198407 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e9cb0201-9089-44c3-9a39-2b30e85454f4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.398918 Aug 30 12:09:10.198407 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 78/157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:09 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:11.218229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:11.219459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:11.228134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:11.228779 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:11.235242 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:11.236306 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:11.237290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:11.237913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:11.511136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:11.520933 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-084de7a7-ac1d-4a35-8de9-856233b40b74 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.307832 Aug 30 12:09:11.521507 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 80/158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:11 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:12.548304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:12.549010 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:12.555272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:12.555759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:12.556443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:12.557130 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:12.557574 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:12.558791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:12.731403 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:12.741138 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fc68e742-96d4-4f65-85e1-82b5b4ded150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.197193 Aug 30 12:09:12.745698 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 79/159] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:12 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:13.765185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:13.767647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:13.774507 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:13.774982 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:13.775410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:13.776113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:13.776567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:13.777048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:13.957512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:13.966397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a391cefe-a549-4277-acd7-201f45ddf61b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.204937 Aug 30 12:09:13.967212 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 81/160] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:13 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:14.989864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:14.990468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:14.996709 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:14.997346 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:14.997889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:14.998729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:14.999293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:14.999822 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:15.237897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:15.247599 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4e213a8c-0edd-4aec-b3cd-64b737d06dcc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.262846 Aug 30 12:09:15.250154 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 80/161] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:14 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:16.297200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:16.303885 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:16.334101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:16.334948 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:16.335564 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:16.336747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:16.338717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:16.340070 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:16.569778 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:16.578824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-790cb6a4-4783-4c4e-a4cb-0bea9bc44ce9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.309522 Aug 30 12:09:16.579595 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 82/162] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:16 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:17.601176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:17.601841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:17.619379 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:17.620302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:17.620847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:17.621795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:17.622882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:17.623382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:17.841292 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:17.850277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b5c28ed4-d646-497c-acc6-54936abd755d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.253233 Aug 30 12:09:17.854385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 81/163] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:17 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:18.878728 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:18.880059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:18.891171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:18.891774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:18.892346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:18.893155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:18.893739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:18.895930 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:19.163872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:19.178375 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d7a11b17-fadc-45b2-9ce0-af7d2ad67a42 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.305316 Aug 30 12:09:19.180303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 83/164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:18 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:20.202321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:20.203649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:20.210533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:20.212110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:20.212705 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:20.214106 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:20.214904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:20.215203 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:20.382375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:20.392421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4b74062f-dff4-4f98-9b17-ca3ce004a86f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.193990 Aug 30 12:09:20.393239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 82/165] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:20 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:20.480111 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4a35daa1-ca69-48c6-a228-16efe1b8712c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'create', calling method: .version_select at 0x7efe4f0150d0>, body: {"keypair": {"name": "tempest-keypair-1865461256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByZGTwqOxGvZvpU/eZGW8y1Cyzx1oIROqv/IcaoHi/zn7JYakGYdy9nqNmYUoSNMEe6N28t5AG7B9d2JKlmz/4RugbMuxbbn3HaFN2e57894L99gIU62ojfHRyvuJPx1A=="}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:09:20.511704 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-4a35daa1-ca69-48c6-a228-16efe1b8712c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:09:20.517637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-4a35daa1-ca69-48c6-a228-16efe1b8712c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for user 04a0c4a52ae34e71bda4903c305b58a4 and project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:09:20.663159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4a35daa1-ca69-48c6-a228-16efe1b8712c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.323320 Aug 30 12:09:20.664265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 84/166] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:09:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:09:21.421954 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:21.423463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:21.432080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:21.436082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:21.436082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:21.436082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:21.436082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:21.436809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:21.667380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:21.677545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d55ef3ac-b7c9-44f1-91e5-619d0c967716 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.259586 Aug 30 12:09:21.678325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 83/167] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:21 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:22.705648 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:22.706272 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:22.723587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:22.724191 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:22.727542 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:22.730434 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:22.732368 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:22.735772 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:22.984858 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:22.993218 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0650ad0e-4bea-4ffd-ab34-51d07bae7319 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.292170 Aug 30 12:09:22.993812 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 85/168] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:22 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:23.894156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-245783768", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb3dfe21-67bc-46c0-8929-2517d26faf12"}], "security_groups": [{"name": "tempest-securitygroup--1603527115"}], "key_name": "tempest-keypair-1865461256", "user_data": "}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:09:24.014679 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:24.015372 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:24.018510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] validate_networks() for [('cb3dfe21-67bc-46c0-8929-2517d26faf12', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:09:24.022555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:24.023050 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:24.023484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:24.024261 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:24.024712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:24.025329 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:24.211278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:24.222316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6f9df0df-df33-436c-8c30-8b793a892a0d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.211146 Aug 30 12:09:24.223217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 86/169] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:24 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:24.451825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:09:24.452284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:09:24.452812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:09:24.453221 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:09:24.453628 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:09:24.469985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:24.474037 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:24.474490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:24.475320 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:24.475789 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:24.476248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:24.498610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:09:24.507013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for user 04a0c4a52ae34e71bda4903c305b58a4 and project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:09:24.522109 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:09:24.524637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:09:24.743340 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c53bcbc4-3064-4843-9de2-0777f3f96b62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.853661 Aug 30 12:09:24.744362 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 84/170] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:09:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:09:24.755199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-40c3535b-2bb9-4b38-bafc-4539e0252e90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:24.755717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-40c3535b-2bb9-4b38-bafc-4539e0252e90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:24.810940 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-40c3535b-2bb9-4b38-bafc-4539e0252e90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:24.818118 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-40c3535b-2bb9-4b38-bafc-4539e0252e90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1237 microversion: 2.1 time: 0.066729 Aug 30 12:09:24.818758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 87/171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:24 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:25.245127 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:25.245727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:25.257853 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:25.268262 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:25.268741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:25.269596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:25.270062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:25.270485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:25.443841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:25.451991 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0e340fb6-6d97-4961-9525-356f3c0601e6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.210627 Aug 30 12:09:25.457938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 85/172] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:25 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:25.841012 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c92ac332-0ed1-4530-b5f1-9036acc213d6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:25.842356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c92ac332-0ed1-4530-b5f1-9036acc213d6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:25.910625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c92ac332-0ed1-4530-b5f1-9036acc213d6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:25.918205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c92ac332-0ed1-4530-b5f1-9036acc213d6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1237 microversion: 2.1 time: 0.082012 Aug 30 12:09:25.918897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 88/173] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:25 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:26.474067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:26.474849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:26.481329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:26.481890 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:26.482325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:26.483023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:26.483480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:26.484006 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:26.631976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:26.639818 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fb3df037-4f1c-416d-a229-1b07616adf14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.170729 Aug 30 12:09:26.640417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 86/174] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:26 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:26.938904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:26.940275 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:26.946730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:26.947223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:26.947655 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:26.948396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:26.948854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:26.949666 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:27.033035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:27.042498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7339fc9e-94d2-4d05-9480-bb6f6620646f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1241 microversion: 2.1 time: 0.107652 Aug 30 12:09:27.056165 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 89/175] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:26 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1241 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:27.661606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:27.662154 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:27.668487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:27.669154 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:27.669661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:27.670278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:27.670807 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:27.671224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:27.817834 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:27.828040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-adc8e9b2-4032-4c5f-9271-cc1fb1328465 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.169265 Aug 30 12:09:27.828040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 87/176] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:27 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:28.062439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:28.063150 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:28.070523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:28.070907 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:28.071340 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:28.072040 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:28.072491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:28.072906 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:28.136438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:28.139969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:28.145290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b4b5e7cb-b1cb-4d77-bd60-519e71808708 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1289 microversion: 2.1 time: 0.086667 Aug 30 12:09:28.145861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 90/177] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:28 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:28.849850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:28.850442 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:28.856358 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:28.856830 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:28.857253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:28.857923 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:28.858360 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:28.858772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:28.999777 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:29.007655 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8fc665d6-7281-4b1f-ac98-bb8528b2c62b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.161862 Aug 30 12:09:29.008251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 88/178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:28 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:29.166055 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:29.166657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:29.169373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:29.174382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:29.174777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:29.175257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:29.175939 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:29.176412 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:29.176837 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:29.242639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:29.250389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0863f9d4-bd4c-4dfa-9d02-e644feccc3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1289 microversion: 2.1 time: 0.088227 Aug 30 12:09:29.252576 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 91/179] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:29 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:30.028876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:30.029475 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:30.036184 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:30.036655 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:30.037082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:30.037747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:30.038196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:30.038606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:30.165252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:30.173305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9bbe6090-5a40-4eed-8c10-4109e7fae20e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.148210 Aug 30 12:09:30.173864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 89/180] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:30 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:30.273571 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:30.274176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:30.288196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:30.288196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:30.288196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:30.288196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:30.288584 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:30.288584 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:30.348113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:30.355696 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-19611919-c9d0-479c-99da-c14359f23030 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1289 microversion: 2.1 time: 0.086105 Aug 30 12:09:30.356294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 92/181] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:30 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:31.194394 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:31.195014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:31.201574 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:31.202071 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:31.202488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:31.203230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:31.204307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:31.204791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:31.336091 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:31.339527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:31.344043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5873e364-3899-4510-885e-e232b58111a1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1519 microversion: 2.1 time: 0.153693 Aug 30 12:09:31.345423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 90/182] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:31 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:31.376682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:31.377287 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:31.383986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:31.384504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:31.384935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:31.385611 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:31.386060 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:31.386474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:31.451091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:31.462094 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-564e974e-003d-48b5-83df-978140fc30fb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1289 microversion: 2.1 time: 0.089742 Aug 30 12:09:31.462675 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 93/183] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:31 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:32.366710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:32.367304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:32.369267 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:32.374228 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:32.374713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:32.375144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:32.376047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:32.376633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:32.377061 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:32.482688 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:32.483298 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:32.491455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:32.491959 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:32.492399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:32.493098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:32.493548 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:32.493963 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:32.562497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:32.572953 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d8b48564-f76f-46c6-8653-8d773a571d63 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1499 microversion: 2.1 time: 0.210762 Aug 30 12:09:32.574035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 91/184] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:32 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:32.602152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:32.602152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:32.602849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:32.603000 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:32.603513 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:32.604200 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:32.605729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:32.606457 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:32.607101 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:32.611313 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-956e362c-239a-4a4b-8dfc-7d6154f463e3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1307 microversion: 2.1 time: 0.132363 Aug 30 12:09:32.611900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 94/185] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:32 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:32.751575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:32.764321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2578fc5d-33c2-41b8-949d-54626888e42e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1516 microversion: 2.1 time: 0.173062 Aug 30 12:09:32.768724 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 92/186] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:32 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:33.634455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:33.635212 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:33.642463 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:33.645761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:33.645761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:33.645761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:33.645761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:33.646238 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:33.778547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:33.787541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d3be9917-c8bb-40ac-bafb-ce72f1153c42 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.156937 Aug 30 12:09:33.788138 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 95/187] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:33 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:34.808988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:34.809588 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:34.811483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:34.812155 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=6 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:34.817619 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:34.818103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:34.818720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:34.819397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:34.819848 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:34.820283 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:34.953103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:34.961349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ff5ded3f-ab98-4513-91ee-4fcd18a2e1f2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.156137 Aug 30 12:09:34.961906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 93/188] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:34 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:35.982296 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:35.982894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:35.986640 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=8 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:35.991310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:35.991808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:35.992429 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:35.993167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:35.993886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:35.994315 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:36.205759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:36.214708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b09b1aed-46df-4aec-9abb-b8f1b6c6a87d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.236145 Aug 30 12:09:36.215287 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 96/189] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:35 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:36.372085 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-be524bd9-286c-45fd-ac9f-5308235e8da5 req-adf1b8b2-d673-4f96-8d36-7ad778f4cb96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17fac3ff-6458-4118-994c-d9eebd1b8a30", "tag": "d9f16a23-193f-4540-a8ab-c5ee53e24e8e"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:09:36.383840 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-be524bd9-286c-45fd-ac9f-5308235e8da5 req-adf1b8b2-d673-4f96-8d36-7ad778f4cb96 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:36.384562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-be524bd9-286c-45fd-ac9f-5308235e8da5 req-adf1b8b2-d673-4f96-8d36-7ad778f4cb96 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:36.385149 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-be524bd9-286c-45fd-ac9f-5308235e8da5 req-adf1b8b2-d673-4f96-8d36-7ad778f4cb96 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:36.397018 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-be524bd9-286c-45fd-ac9f-5308235e8da5 req-adf1b8b2-d673-4f96-8d36-7ad778f4cb96 service nova] Creating event network-changed:d9f16a23-193f-4540-a8ab-c5ee53e24e8e for instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 on hv-cinder-83976 Aug 30 12:09:36.402100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-be524bd9-286c-45fd-ac9f-5308235e8da5 req-adf1b8b2-d673-4f96-8d36-7ad778f4cb96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036545 Aug 30 12:09:36.402688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 94/190] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:09:36.786655 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:09:36.788974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:36.795596 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:36.796130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:36.796567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:36.797296 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:36.798380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:36.798807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:36.822420 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lazy-loading 'flavor' on Instance uuid f10ec061-4640-4100-bc70-536c1e6f263c {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:09:37.105806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6d906a27-11cf-401a-aec9-d811ba5845da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c/action" status: 200 len: 32 microversion: 2.1 time: 0.324449 Aug 30 12:09:37.108229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 97/191] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:09:36 2022] POST /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:09:37.127045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:37.128075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:37.135569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:37.136081 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:37.136511 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:37.137252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:37.137655 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:37.138069 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:37.250652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:37.251762 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:37.259399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:37.260235 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:37.260874 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:37.261650 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:37.262259 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:37.262841 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:37.310456 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:37.319001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2391ecec-6364-4209-a2f0-200b96667947 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.197763 Aug 30 12:09:37.319710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 95/192] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:37 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:37.807058 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:37.822129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-87d51184-cf98-4a45-b765-c87e74609296 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.575850 Aug 30 12:09:37.822888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 98/193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:37 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:38.347096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:38.348912 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:38.357386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:38.358881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:38.360826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:38.361900 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:38.362505 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:38.363591 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:38.533207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:38.542450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1f12259b-dc38-46a2-ab67-7e04bf335063 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.201956 Aug 30 12:09:38.543207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 96/194] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:38 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:38.843819 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:38.845678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:38.852848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:38.855263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:38.855263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:38.855263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:38.855263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:38.855594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:39.005310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:39.012962 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ca88579a-ca88-4dc7-9048-7545d29cb3e0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.173639 Aug 30 12:09:39.013519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 99/195] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:38 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:39.563454 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:39.564153 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:39.570166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:39.571007 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:39.571384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:39.572089 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:39.572535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:39.572943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:39.774441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:39.782690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-91b75a2c-43ae-4d63-b22a-ca0becc1f307 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.223511 Aug 30 12:09:39.783278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 97/196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:39 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:40.033950 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:40.035314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:40.041703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:40.042216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:40.042648 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:40.043339 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:40.043792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:40.044256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:40.182369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:40.190229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-645ccf30-349c-43d8-b886-f596f5bfd571 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.160700 Aug 30 12:09:40.190802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 100/197] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:40 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:40.803452 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:40.804087 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:40.810296 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:40.810826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:40.811213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:40.812214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:40.813520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:40.814119 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:40.969337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:40.977650 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9c99e29c-b684-4279-9307-7c9657ca8ebf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.178113 Aug 30 12:09:40.978233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 98/198] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:40 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:41.213455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:41.213844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:41.221493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:41.223904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:41.223904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:41.223904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:41.223904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:41.224609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:41.371262 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:41.380184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7366f7cb-7087-4057-befd-5fd462ed9dda tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.171224 Aug 30 12:09:41.384139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 101/199] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:41 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:42.001372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:42.002080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:42.008572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:42.009054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:42.009484 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:42.010170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:42.010621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:42.011046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:42.019904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:42.020490 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:42.026420 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:42.027115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:42.027785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:42.028703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:42.029133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:42.029612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:42.055079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8e63e06c-70c1-48b1-a162-db1e7e2ad75e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/ips" status: 200 len: 151 microversion: 2.20 time: 0.040020 Aug 30 12:09:42.057117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 102/200] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Aug 30 12:09:42 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 12:09:42.196065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:42.206147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1a89dad4-8f79-4c22-b017-8e8513a436bb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.209853 Aug 30 12:09:42.207475 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 99/201] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:41 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:42.403351 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:42.403999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:42.413558 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:42.414826 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:42.415547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:42.416927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:42.417809 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:42.418422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:42.628987 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:42.637197 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a8993736-81df-4023-8e3a-936f1247acee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.238670 Aug 30 12:09:42.638010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 103/202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:42 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:43.229249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:43.230478 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:43.241277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:43.241277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:43.241277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:43.243169 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:43.244630 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:43.248535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:43.452049 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:43.463415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b91bc221-68d4-46b9-b85a-26948fcc273b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.238166 Aug 30 12:09:43.464158 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 100/203] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:43 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:43.658061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:43.658698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:43.664964 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:43.670200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:43.670200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:43.670200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:43.670200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:43.670541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:43.949544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:43.957971 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2effc54a-b54c-4632-b827-5de4c84711ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.303850 Aug 30 12:09:43.958569 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 104/204] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:43 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:44.486965 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:44.487563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:44.493639 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:44.494112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:44.494567 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:44.495246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:44.495688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:44.496305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:44.649484 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:44.663107 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2f382ca5-950b-4b6b-a8c4-7ae6540fcc14 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.180271 Aug 30 12:09:44.663860 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 101/205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:44 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:44.963330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:09:44.963999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:44.971876 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:44.972417 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:44.972847 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:44.973549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:44.974006 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:44.974451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:44.979056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:44.979749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:44.986582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:44.987259 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:44.987754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:44.988522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:44.988972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:44.989384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:44.998014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lazy-loading 'flavor' on Instance uuid 294a2d1c-a5ff-4f5e-945f-03a42a7800cc {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:09:45.002271 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:45.165433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:45.174080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e287491d-2403-42ae-abaa-1330f31019af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.198937 Aug 30 12:09:45.175732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 102/206] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:44 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:45.676578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-fcc9defd-b388-48a7-9e19-8dcccf205064 req-da075a13-286f-4ff7-95b4-0fe58ad6b1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17fac3ff-6458-4118-994c-d9eebd1b8a30", "name": "network-vif-plugged", "status": "completed", "tag": "d9f16a23-193f-4540-a8ab-c5ee53e24e8e"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:09:45.691916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fcc9defd-b388-48a7-9e19-8dcccf205064 req-da075a13-286f-4ff7-95b4-0fe58ad6b1a3 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:45.691916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fcc9defd-b388-48a7-9e19-8dcccf205064 req-da075a13-286f-4ff7-95b4-0fe58ad6b1a3 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:45.691916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fcc9defd-b388-48a7-9e19-8dcccf205064 req-da075a13-286f-4ff7-95b4-0fe58ad6b1a3 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:45.713058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-fcc9defd-b388-48a7-9e19-8dcccf205064 req-da075a13-286f-4ff7-95b4-0fe58ad6b1a3 service nova] Creating event network-vif-plugged:d9f16a23-193f-4540-a8ab-c5ee53e24e8e for instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 on hv-cinder-83976 Aug 30 12:09:45.720863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-fcc9defd-b388-48a7-9e19-8dcccf205064 req-da075a13-286f-4ff7-95b4-0fe58ad6b1a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050436 Aug 30 12:09:45.734841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 103/207] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:09:45.734841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:45.734841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:45.740674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:45.741242 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:45.741758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:45.742531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:45.746004 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:45.746004 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:45.787142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ac69da06-22b3-4f2e-9f4d-e0cd87df03f8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/action" status: 202 len: 0 microversion: 2.20 time: 0.827798 Aug 30 12:09:45.788092 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 105/208] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Aug 30 12:09:44 2022] POST /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 12:09:45.811346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:45.813221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:45.822410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:45.823184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:45.823907 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:45.824790 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:45.825431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:45.826009 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:46.060325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:46.071488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3c421655-69af-455f-bd8a-ec11e88ae0b9 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.344332 Aug 30 12:09:46.084541 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 104/209] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:45 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:46.093205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:46.102456 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:46.103897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:46.105098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3ff18fb5-61f2-4336-a0cf-3b0083560592 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.312603 Aug 30 12:09:46.105684 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 106/210] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:45 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:09:46.197468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:46.198071 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:46.205985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:46.206800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:46.207394 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:46.208386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:46.209048 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:46.209632 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:46.369452 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:46.378915 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-540cf800-e357-4d90-8013-5505dbf743af tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.185593 Aug 30 12:09:46.381358 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 105/211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:46 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:47.093100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:47.093739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:47.103354 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:47.103848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:47.109035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:47.109035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:47.109035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:47.109035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:47.129988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:47.130597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:47.136929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:47.137444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:47.137866 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:47.138745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:47.139186 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:47.139610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:47.301664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:47.310174 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:47.311634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:47.312857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-81030250-3f00-4a0c-8c82-ba30b13575a5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.186943 Aug 30 12:09:47.314110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 106/212] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:47 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:47.351362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:47.364223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d913ee65-05ac-4487-bc2e-895099cd7bbf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.274940 Aug 30 12:09:47.364857 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 107/213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:47 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:47.406474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:47.407762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:47.415313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:47.415806 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:47.416265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:47.416987 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:47.417424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:47.417845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:47.574775 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:47.583832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-792993b9-2ec1-4903-9909-9db8c38e096b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.182776 Aug 30 12:09:47.584462 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 107/214] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:47 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:48.336367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:48.337468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:48.346262 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:48.346814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:48.347692 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:48.348583 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:48.349032 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:48.352314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:48.386760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:48.387376 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:48.394116 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:48.394566 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:48.395449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:48.396335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:48.396967 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:48.397551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:48.510192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:48.521622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:48.523132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:48.524346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c049e504-5311-41a4-ba81-d8c59d51ea3e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.192190 Aug 30 12:09:48.532859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 108/215] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:48 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:48.606977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:48.607836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:48.614789 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:48.615620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:48.616334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:48.617256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:48.617825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:48.618325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:48.742642 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:48.746192 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:09:48.750894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cdd303c5-df3a-4006-9f96-a76551015ee0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.367954 Aug 30 12:09:48.751727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 108/216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:48 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:48.770908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:48.776843 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-73226752-645e-46f9-9961-a3fee74a9acf tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.173468 Aug 30 12:09:48.778037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 109/217] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:48 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:49.549090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:49.549673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:49.555584 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:49.556256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:49.556877 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:49.557561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:49.558014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:49.558435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:49.773117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:49.774332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:49.783031 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:49.784033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:49.784478 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:49.785340 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:49.786014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:49.786450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:49.842295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:49.865291 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:49.867039 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:49.868786 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-37e757a7-ad1b-4360-b567-217d4ee69315 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.324729 Aug 30 12:09:49.869587 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 109/218] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:49 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:49.874908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:49.876326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:49.883224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:49.883974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:49.884653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:49.885574 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:49.886229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:49.886854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:49.933192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:49.941352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-087317a9-f3aa-43dd-86b9-bcaae6f859a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.172397 Aug 30 12:09:49.941998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 110/219] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:49 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:50.109821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:50.129076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3c70fa38-ddfc-4f09-8f9c-3d5c9b745f47 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.258216 Aug 30 12:09:50.129664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 110/220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:49 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:50.898347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:50.899687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:50.907866 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:50.908907 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:50.909557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:50.910489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:50.911152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:50.911813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:50.962992 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:50.964372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:50.971852 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:50.972755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:50.973399 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:50.974321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:50.974977 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:50.975629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:51.061184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:51.070525 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:51.072533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:51.073748 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5e3fbf1d-fac1-49ab-a61f-767b49d2344a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.179328 Aug 30 12:09:51.074463 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 111/221] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:50 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:51.155037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:51.155037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:51.159219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:51.159219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:51.159219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:51.159219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:51.159591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:51.159938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:51.347773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:51.357778 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f5c12f77-5cbc-45e3-903c-6e7256bd6455 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1363 microversion: 2.1 time: 0.211725 Aug 30 12:09:51.362218 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 112/222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:51 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:51.427392 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:51.440218 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c078b41d-451d-4ea5-8339-8ea2b1751172 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.480722 Aug 30 12:09:51.449500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 111/223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:50 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:52.099346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:52.100849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:52.108588 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.109582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.110981 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.112122 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.112793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.116637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.387650 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:52.388292 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:52.404692 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.405183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.412891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.412891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.412891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.412891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.441362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:52.451992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:52.453451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:52.455841 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-43a492f2-14e4-45e8-89d2-625290b648d2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.362335 Aug 30 12:09:52.456451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 113/224] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:52 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:52.461184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:52.461934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:52.470897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.471767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.472597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.473455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.474095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.474961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.663463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:52.689075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ad5ecd4d-22bf-423b-9a7e-8f8ccb093a85 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1548 microversion: 2.1 time: 0.298488 Aug 30 12:09:52.689746 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 112/225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:52 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1548 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:52.713630 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:52.714135 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:52.725053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.725713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.726285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.727104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:52.727679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:52.728265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:52.802048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:52.814949 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-99bb4773-247e-420c-8207-d068d3f78ed3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.356169 Aug 30 12:09:52.815556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 114/226] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:52 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:53.020733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7c2ac5d1-2928-42aa-a387-cde404986a2c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.313338 Aug 30 12:09:53.021916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 113/227] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:09:52 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:09:53.481920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:53.483185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:53.497421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:53.498319 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:53.499112 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:53.503253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:53.504153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:53.504814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:53.851968 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:53.852631 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:53.868826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:53.869313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:53.869740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:53.870589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:53.870868 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:53.871282 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:53.997074 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:54.007108 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:54.010883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:54.012441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-02962d0c-5c2a-4e6b-ad60-32a218c087fa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.534850 Aug 30 12:09:54.013825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 115/228] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:53 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:54.178958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:54.187665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f07dde3e-7a13-4e70-9203-7ddd49cd489c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.341801 Aug 30 12:09:54.189230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 114/229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:53 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:55.039411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:55.040243 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:55.050852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:55.051431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:55.052202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:55.053192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:55.053889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:55.054514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:55.211451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:55.212147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:55.232933 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:55.240293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:55.241045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:55.243679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:55.244410 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:55.245649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:55.420194 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:55.430119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:55.437296 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:55.439064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-68c7f0a7-1b78-4e06-897b-e841933141ed tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.404329 Aug 30 12:09:55.444278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 116/230] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:55 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:55.455217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-7eeaa723-34bb-44d0-bd4c-335efe2c2053 req-8eabcaf1-d754-4742-aa6f-01af9654a96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17fac3ff-6458-4118-994c-d9eebd1b8a30", "tag": "d9f16a23-193f-4540-a8ab-c5ee53e24e8e"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:09:55.477254 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-7eeaa723-34bb-44d0-bd4c-335efe2c2053 req-8eabcaf1-d754-4742-aa6f-01af9654a96b service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:55.478096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-7eeaa723-34bb-44d0-bd4c-335efe2c2053 req-8eabcaf1-d754-4742-aa6f-01af9654a96b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:55.478780 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-7eeaa723-34bb-44d0-bd4c-335efe2c2053 req-8eabcaf1-d754-4742-aa6f-01af9654a96b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:55.492871 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-7eeaa723-34bb-44d0-bd4c-335efe2c2053 req-8eabcaf1-d754-4742-aa6f-01af9654a96b service nova] Creating event network-changed:d9f16a23-193f-4540-a8ab-c5ee53e24e8e for instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 on hv-cinder-83976 Aug 30 12:09:55.507024 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-7eeaa723-34bb-44d0-bd4c-335efe2c2053 req-8eabcaf1-d754-4742-aa6f-01af9654a96b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053710 Aug 30 12:09:55.509754 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 117/231] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:09:55.579345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:55.605958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-13b86ad8-c540-4aec-9957-797b2e18a3ea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.400117 Aug 30 12:09:55.609520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 115/232] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:55 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:09:56.473427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:56.474179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:56.485359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:56.487493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:56.492027 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:56.492027 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:56.495531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:56.496439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:56.632252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:56.633550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:56.645066 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:56.649510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:56.650193 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:56.650949 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:56.651529 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:56.653380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:56.900939 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:56.915307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:56.917640 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:56.919274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d1b197cb-0888-4828-99ef-5214d63bb2b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.452197 Aug 30 12:09:56.931971 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 118/233] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:56 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:56.937519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:56.951482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1ec979a6-1b44-48a8-8a70-f40134e58a19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.323972 Aug 30 12:09:56.952214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 116/234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:56 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:57.945085 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:57.953052 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:57.957349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:57.957989 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:57.960499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:57.961232 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:57.961698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:57.962603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:57.974043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:57.974874 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:57.984962 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:57.985943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:57.986564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:57.987599 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:57.998086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:57.999012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:58.338693 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:58.363170 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:58.364673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:58.366718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4b8c2160-2a43-44ab-83c0-dab54738374d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.425527 Aug 30 12:09:58.366718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 119/235] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:57 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:58.392194 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:58.402467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-233a4c94-0786-4172-a635-61dfe8709e37 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.433158 Aug 30 12:09:58.407217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 117/236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:57 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:09:59.388655 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:59.389350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:59.403304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:59.407925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:59.412687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:59.412687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:59.412687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:59.412687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:59.433504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:09:59.437453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:09:59.458193 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:59.461196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:59.462088 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:59.465637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:09:59.469837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:09:59.471089 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:09:59.825189 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:59.837167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:59.845303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:59.855224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c904a415-5fd3-4133-9dbe-b28baa923cbc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.462324 Aug 30 12:09:59.856678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 120/237] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:09:59 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:09:59.882002 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:09:59.896420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b90a1202-a13e-4abb-aa13-bfda5506dbc4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.466529 Aug 30 12:09:59.906988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 118/238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:09:59 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:00.886096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:00.886930 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:00.896115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=60 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:00.898079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:00.898575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:00.899012 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:00.899718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:00.900205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:00.900627 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:00.905519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:00.918808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:00.924763 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:00.927989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:00.931126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:00.931729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:00.933373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:00.935119 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:00.940099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:01.324445 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:01.336115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:01.352181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:01.353680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c7ce06d5-9a86-4898-b4cf-43130c7b0e2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.472714 Aug 30 12:10:01.354274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 121/239] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:00 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:01.383014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:01.424900 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a0b119c5-d997-426d-9168-5510c9f6fb52 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.508109 Aug 30 12:10:01.427583 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 119/240] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:00 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:02.390528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:02.393793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:02.401827 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.402332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.402772 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.404157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.404961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.405724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.449613 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:02.451028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:02.459059 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.459760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.460663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.461601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.471777 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.481257 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.740690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:02.752327 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d89d69b6-1ad5-4cdf-90a7-3f887530e43a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1502 microversion: 2.1 time: 0.306662 Aug 30 12:10:02.753534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 120/241] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:02 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:02.775881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f11c6aa5-7dcb-47d8-940d-a8ef8884f910"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:02.778941 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:02.787352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=60 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:02.789007 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.789495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.790089 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.791281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.791748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.792666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] HTTP exception thrown: Cannot 'attach_volume' instance f10ec061-4640-4100-bc70-536c1e6f263c while it is in vm_state rescued Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Request method failure captured: Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: POST /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c/os-volume_attachments HTTP/1.1 Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 74 Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2chFL7TTDwBqSSUV8iHuKCFNI9kKGw22-zu3q6bTt-658jo2vyt5oBlVcxKaJsHKfjJjzYa9xyikpmnUk2gSMTEKNjyQmyznycs6wSfrKqi2r_B-Slk13ypWUgPlEVY35EcNk2EtR1HiHVw50oruSpIXKm9bZWchHF3EIyqM_E5_A Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:10:02.840294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c040647b03574d3a87a335e10d02ef49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 012ead000e8d411eae7034f296455fe7 Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {"volumeAttachment": {"volumeId": "f11c6aa5-7dcb-47d8-940d-a8ef8884f910"}} Aug 30 12:10:02.847386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Cannot 'attach_volume' instance f10ec061-4640-4100-bc70-536c1e6f263c while it is in vm_state rescued Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'server_id': 'f10ec061-4640-4100-bc70-536c1e6f263c', 'body': {'volumeAttachment': {'volumeId': 'f11c6aa5-7dcb-47d8-940d-a8ef8884f910'}}} Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f10ec061-4640-4100-bc70-536c1e6f263c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:10:02.848308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f10ec061-4640-4100-bc70-536c1e6f263c while it is in vm_state rescued Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:10:02.849937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:10:02.852653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:10:02.852653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:10:02.852653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f10ec061-4640-4100-bc70-536c1e6f263c while it is in vm_state rescued Aug 30 12:10:02.852653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:10:02.852653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Returning 409 to user: Cannot 'attach_volume' instance f10ec061-4640-4100-bc70-536c1e6f263c while it is in vm_state rescued {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:10:02.852653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7e94d400-5c30-4809-b234-b80b05a41f72 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069905 Aug 30 12:10:02.852653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 121/242] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:10:02 2022] POST /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 12:10:02.861245 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:02.868921 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:02.869901 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.870100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.870548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.871255 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:02.872388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:02.872817 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:02.945074 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:02.960717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:02.962366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:02.964778 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4d2d5c14-ad91-4226-bdd0-b7b479a737fb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1745 microversion: 2.20 time: 0.578582 Aug 30 12:10:02.965282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 122/243] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:02 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1745 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:03.127472 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2c04fe23-9736-46d1-ba9d-7e5065515b78 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c/action" status: 202 len: 0 microversion: 2.1 time: 0.264990 Aug 30 12:10:03.128801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 122/244] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:10:02 2022] POST /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:10:03.137393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:03.138063 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:03.150261 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:03.156293 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:03.157107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:03.158942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:03.159539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:03.161123 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:03.621448 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:03.634049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-89c8cf7a-e112-4beb-ba4e-6da4c74e9313 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1510 microversion: 2.1 time: 0.500190 Aug 30 12:10:03.636469 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 123/245] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:03 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1510 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:03.993527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:03.994229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:04.007473 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:04.008233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:04.009103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:04.009925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:04.010387 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:04.010954 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:04.336143 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:04.347680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:04.354705 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:04.356549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b24dfc43-6dc4-46ee-99e3-aa5fd2b3b398 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1745 microversion: 2.20 time: 0.368991 Aug 30 12:10:04.370455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 123/246] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:03 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1745 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:04.541426 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0c183c44-90b7-4ddf-8151-10c73abd1605 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Action: 'create', calling method: .version_select at 0x7efe4f2fd940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1243030642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCACRSjhgxie3KaU/I377Khwg75EcgLXvl+VJSeIdFR7uYpaOErw3lLXlDPX4VqQGZzcxoH48ilc2qfVqiFsFzbzMinqGEgY/Y90B8BiGKtF5yo74CkhkqhXbTywxafDXg=="}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:04.613477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-0c183c44-90b7-4ddf-8151-10c73abd1605 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:10:04.620307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-0c183c44-90b7-4ddf-8151-10c73abd1605 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for user 3733f8f0d14746949cbe92c9d370c33e and project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:10:04.659040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:04.659902 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:04.671697 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:04.671697 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:04.671697 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:04.671697 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:04.672229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:04.672229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:04.717102 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0c183c44-90b7-4ddf-8151-10c73abd1605 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.535040 Aug 30 12:10:04.723350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 124/247] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:10:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:04.917401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:04.926314 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6aeb5756-2e2a-49ce-9a9b-25d1b8f8702b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1510 microversion: 2.1 time: 0.272431 Aug 30 12:10:04.927170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 124/248] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:04 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:05.382920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:05.383579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:05.411700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:05.412613 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:05.413761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:05.414706 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:05.415309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:05.415932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:05.685187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:05.696873 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:05.710665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:05.713342 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ba0e590d-54ec-4b16-9cd1-708b50b07c78 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1745 microversion: 2.20 time: 0.334997 Aug 30 12:10:05.714904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 125/249] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:05 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1745 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:05.795054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-3b640be8-f66d-4610-a8d8-84664353caaa req-8f2e22c1-11e9-4821-92fa-5647ead703eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294a2d1c-a5ff-4f5e-945f-03a42a7800cc", "name": "network-vif-plugged", "status": "completed", "tag": "1a156fe5-05f5-48b0-bb53-3f8c98e5846a"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:05.816455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-3b640be8-f66d-4610-a8d8-84664353caaa req-8f2e22c1-11e9-4821-92fa-5647ead703eb service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:05.816455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-3b640be8-f66d-4610-a8d8-84664353caaa req-8f2e22c1-11e9-4821-92fa-5647ead703eb service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:05.816455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-3b640be8-f66d-4610-a8d8-84664353caaa req-8f2e22c1-11e9-4821-92fa-5647ead703eb service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:05.816455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:05.826204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-3b640be8-f66d-4610-a8d8-84664353caaa req-8f2e22c1-11e9-4821-92fa-5647ead703eb service nova] Creating event network-vif-plugged:1a156fe5-05f5-48b0-bb53-3f8c98e5846a for instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc on hv-cinder-83976 Aug 30 12:10:05.833421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-3b640be8-f66d-4610-a8d8-84664353caaa req-8f2e22c1-11e9-4821-92fa-5647ead703eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043331 Aug 30 12:10:05.834677 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 125/250] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:05.952733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:05.961981 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:05.969553 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:05.970729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:05.971358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:05.972376 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:05.972982 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:05.974025 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:06.138812 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:06.147114 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5faf9a3b-3b70-4c7e-bc05-bc2854b236cb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1510 microversion: 2.1 time: 0.198807 Aug 30 12:10:06.147724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 126/251] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:05 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:06.738661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:06.739557 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:06.746927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:06.747516 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:06.747968 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:06.748890 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:06.749347 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:06.750430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:06.931043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:06.951936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:06.955434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:06.955832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2ac0f39d-47ea-4427-b210-c37fbe22af2a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1745 microversion: 2.20 time: 0.222407 Aug 30 12:10:06.956460 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 126/252] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:06 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:07.169158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:07.169879 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:07.178955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:07.179687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:07.180401 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:07.181309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:07.181963 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:07.182591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:07.353827 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:07.362443 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-69497046-c949-4731-9b75-2f56a4c39bac tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1510 microversion: 2.1 time: 0.197556 Aug 30 12:10:07.363002 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 127/253] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:07 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:07.470571 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1479257391", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "networks": [{"uuid": "7c842611-2f64-466c-bd69-f602304d47ee"}]}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:07.558694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] validate_networks() for [('7c842611-2f64-466c-bd69-f602304d47ee', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:10:07.980538 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:07.981672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:08.003852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:08.005712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:08.008011 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:08.009060 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:08.011577 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:08.012309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:08.235479 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:10:08.236527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:10:08.236993 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:10:08.237394 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:10:08.237828 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:10:08.247327 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:08.247886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:08.248535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:08.249421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:08.250124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:08.250640 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:08.270103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Getting quotas for project 24cf8197b5444f6e98b6663a5a08c6dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:10:08.275357 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Getting quotas for user 5312919483f944b29317aa22db224503 and project 24cf8197b5444f6e98b6663a5a08c6dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:10:08.302869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:10:08.305845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:10:08.442980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fd5559d2-ac28-45b8-8372-f1a78e5439e2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976769 Aug 30 12:10:08.445470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 127/254] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:10:08.451654 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:08.457072 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:08.489343 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:08.491323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:08.491323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:08.492174 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:08.492792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:08.493375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:08.658240 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:08.680931 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:08.684116 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:08.689549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a7d15bcf-0216-4df8-8853-596afe9dc7ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.710421 Aug 30 12:10:08.689549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 128/255] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:07 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:08.714181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-48650e8c-814e-4817-aeaf-fe7589c09562 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:08.715546 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-48650e8c-814e-4817-aeaf-fe7589c09562 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:08.769811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:08.790970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5eefa9f8-c8fb-4781-a60a-c247cd04a938 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1516 microversion: 2.1 time: 0.344111 Aug 30 12:10:08.804323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 128/256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:08 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1516 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:08.808095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-48650e8c-814e-4817-aeaf-fe7589c09562 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:08.816619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-48650e8c-814e-4817-aeaf-fe7589c09562 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1219 microversion: 2.1 time: 0.128566 Aug 30 12:10:08.817811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 129/257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:08 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:09.754146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:09.754146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:09.754146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:09.754146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:09.755103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:09.755103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:09.755103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:09.755103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:09.844904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ff14f68f-7148-4b83-8548-7e64a2f2f9b4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:09.849815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ff14f68f-7148-4b83-8548-7e64a2f2f9b4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:09.979401 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ff14f68f-7148-4b83-8548-7e64a2f2f9b4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:09.998698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ff14f68f-7148-4b83-8548-7e64a2f2f9b4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1219 microversion: 2.1 time: 0.158348 Aug 30 12:10:10.000886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 130/258] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:09 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:10.091614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:10.102988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:10.107590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:10.112148 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7bf75b31-3879-4d9e-84d2-11835ac3d633 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.404729 Aug 30 12:10:10.114024 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 129/259] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:09 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:11.022929 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:11.024330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:11.038361 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:11.039321 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:11.043634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:11.048317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:11.049013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:11.049645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:11.134782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:11.142543 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:11.143150 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:11.155486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:11.158698 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:11.159339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:11.160977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-14b96e06-d334-41af-923f-1f44d69e7f8c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1271 microversion: 2.1 time: 0.142405 Aug 30 12:10:11.162000 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:11.162559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:11.163969 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:11.165386 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 131/260] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:11 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:11.376239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:11.397569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:11.399842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:11.401370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d45e6d15-adb1-4695-aaf6-8b7ae25e9850 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.264049 Aug 30 12:10:11.402463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 130/261] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:11 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:11.960921 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-49a16f68-94da-4c4b-9986-24fda2920868 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'create', calling method: .version_select at 0x7efe4f1648b0>, body: {"keypair": {"name": "tempest-keypair-1177257713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiZ2aksinFxAbd6aqGdvicxHmNgJcbxRuQHzhSDbveol0WCXKMhZcuJi2BA0BVUWyGZSw7lEqh0tRS6EOdcSfUJvUqvv0O+V4PXy9TAWthw3vULtySlfJh0VX9WI1VRDA=="}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:11.984205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-49a16f68-94da-4c4b-9986-24fda2920868 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for project c040647b03574d3a87a335e10d02ef49. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:10:11.989555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-49a16f68-94da-4c4b-9986-24fda2920868 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for user 012ead000e8d411eae7034f296455fe7 and project c040647b03574d3a87a335e10d02ef49. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:10:12.098763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-49a16f68-94da-4c4b-9986-24fda2920868 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141560 Aug 30 12:10:12.099686 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 132/262] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:10:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:12.192167 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:12.193554 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:12.201280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:12.202281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:12.203512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:12.204734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:12.205256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:12.210246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:12.301974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:12.313073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5160a0d9-2309-40db-b124-65e0dce35d08 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1271 microversion: 2.1 time: 0.125217 Aug 30 12:10:12.314260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 131/263] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:12 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:12.432345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:12.433056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:12.441654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:12.442194 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:12.442719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:12.443624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:12.444308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:12.444856 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:12.592289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:12.602384 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:12.603833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:12.605025 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a783ef7c-07b9-4b65-b70c-1737e2d4a063 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.177032 Aug 30 12:10:12.605585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 133/264] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:12 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:13.335233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:13.336473 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:13.342663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:13.343560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:13.344272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:13.345426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:13.345883 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:13.346306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:13.467772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:13.485156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-26dff6fd-618a-474d-8f1c-57a74aa90332 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1271 microversion: 2.1 time: 0.153756 Aug 30 12:10:13.486814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 132/265] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:13 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:13.628510 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:13.629788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:13.636302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:13.637211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:13.637842 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:13.638945 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:13.640606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:13.641418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:13.860568 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:13.870517 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:13.876495 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:13.879514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8fce53a1-c12e-4468-9f5f-21a8b4535bd8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.254479 Aug 30 12:10:13.879514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 134/266] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:13 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:14.514288 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:14.515255 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:14.528497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:14.544675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:14.544675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:14.544675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:14.544675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:14.551275 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:14.658601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:14.668076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5e682cc0-671c-4af6-b329-cddf495addda tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1271 microversion: 2.1 time: 0.157631 Aug 30 12:10:14.669977 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 133/267] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:14 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:14.902883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:14.904173 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:14.914715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:14.917486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:14.918093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:14.919352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:14.921581 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:14.922251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:15.414818 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:15.434661 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:15.437724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:15.439910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a07e1259-e87c-4a1d-8e83-572c91ae6f2e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.541840 Aug 30 12:10:15.446274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 135/268] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:14 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:15.719274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:15.720351 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:15.774392 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:15.777575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:15.778312 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:15.779889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:15.781852 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:15.783308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:15.910331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:15.927445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fe10cb16-8a31-4c2e-98e9-34c4b0487236 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1277 microversion: 2.1 time: 0.228860 Aug 30 12:10:15.928294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 134/269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:15 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:16.472688 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:16.474814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:16.499708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:16.500262 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:16.500700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:16.504993 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:16.505475 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:16.505910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:16.550171 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-169840242", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81e9b3a1-fda2-4dab-b74c-b9cbb69b5132"}], "security_groups": [{"name": "tempest-securitygroup--335936802"}], "key_name": "tempest-keypair-1177257713", "user_data": "}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:16.732877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:16.743661 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:16.745493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:16.746940 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a8f2c3ea-eafb-4291-8a9e-70282195bb80 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.281082 Aug 30 12:10:16.748088 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 136/270] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:16 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:16.951392 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:16.957012 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:16.968443 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:16.970838 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:16.974034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:16.975031 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:16.976664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:16.979024 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:17.339522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:17.350740 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-30189ee9-3271-452a-ba43-678217e81c65 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.404493 Aug 30 12:10:17.359993 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 137/271] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:16 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:17.772244 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:17.773016 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:17.782858 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:17.784554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:17.789557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:17.789557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:17.789557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:17.791422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:18.074685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:18.087405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:18.088879 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:18.093425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2e0fd762-8a97-48f9-bf42-9db0790777ea tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.322494 Aug 30 12:10:18.098737 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 138/272] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:17 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:18.104583 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-f24271a2-ce90-44f5-bccd-102f1582daf1 req-e6c6482c-8527-4960-bdb1-75a517ed8f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a615cb0-f264-420f-b63a-232ae546db71", "tag": "714eaeee-484b-4696-85eb-8974172eab61"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:18.116553 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-f24271a2-ce90-44f5-bccd-102f1582daf1 req-e6c6482c-8527-4960-bdb1-75a517ed8f67 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:18.119627 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-f24271a2-ce90-44f5-bccd-102f1582daf1 req-e6c6482c-8527-4960-bdb1-75a517ed8f67 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:18.119627 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-f24271a2-ce90-44f5-bccd-102f1582daf1 req-e6c6482c-8527-4960-bdb1-75a517ed8f67 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:18.131152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-f24271a2-ce90-44f5-bccd-102f1582daf1 req-e6c6482c-8527-4960-bdb1-75a517ed8f67 service nova] Creating event network-changed:714eaeee-484b-4696-85eb-8974172eab61 for instance 7a615cb0-f264-420f-b63a-232ae546db71 on hv-cinder-83976 Aug 30 12:10:18.136830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-f24271a2-ce90-44f5-bccd-102f1582daf1 req-e6c6482c-8527-4960-bdb1-75a517ed8f67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036379 Aug 30 12:10:18.142367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 139/273] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:18.259042 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:18.289947 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=6 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:18.377675 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:18.378695 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:18.391267 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:18.393741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:18.395261 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:18.397691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:18.398697 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:18.400473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:18.714656 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:18.724361 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7fef770e-f867-439b-ac96-28593226bf4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.353094 Aug 30 12:10:18.725256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 140/274] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:18 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:19.120695 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:19.121347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:19.135770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:19.136775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:19.139464 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:19.141678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:19.142935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:19.146322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:19.578327 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:19.592103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:19.594876 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:19.596079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7d394722-cfbd-444b-b556-b6512225004f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.480892 Aug 30 12:10:19.596674 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 141/275] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:19 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:19.745795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:19.746433 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:19.755103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:19.755587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:19.764309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:19.766116 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:19.766974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:19.767510 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:19.790362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:19.932991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:19.947753 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7f2a1203-bbdb-4ed2-a553-20a775ee4273 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.205405 Aug 30 12:10:19.948440 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 142/276] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:19 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:20.627711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:20.628525 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:20.635284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:20.635788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:20.636319 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:20.637093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:20.637641 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:20.638125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:20.769622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:20.777712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:20.779179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:20.780450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ac21f783-1e83-48a3-a035-1b6d33868f00 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.158582 Aug 30 12:10:20.781008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 143/277] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:20 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:20.971462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:20.971462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:20.976115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:20.976603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:20.977040 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:20.977733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:20.978183 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:20.978607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:21.138438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:21.154449 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-11c3062e-1f6b-4f45-9d7f-cf1f2da59366 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.189811 Aug 30 12:10:21.156051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 144/278] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:20 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:21.803127 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:21.803769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:21.810383 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:21.810862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:21.811992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:21.812768 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:21.813219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:21.813641 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:21.947709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:21.956017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:21.957474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:21.958626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-51fc3d6c-0d84-4ec6-bacd-34facee4bfc3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.159478 Aug 30 12:10:21.959184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 145/279] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:21 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:22.119524 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] validate_networks() for [('81e9b3a1-fda2-4dab-b74c-b9cbb69b5132', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:10:22.176355 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:22.177049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:22.178966 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=12 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:22.183701 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:22.184292 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:22.184792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:22.185559 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:22.186076 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:22.186666 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:22.325468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:22.333806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-79294fab-5641-4fe0-ac82-c4ddf72c994f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.161415 Aug 30 12:10:22.334444 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 146/280] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:22 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:22.503464 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:10:22.503979 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:10:22.504453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:10:22.504857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:10:22.505260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:10:22.513978 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:22.515004 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:22.515433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:22.516311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:22.516758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:22.517174 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:22.535185 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for project c040647b03574d3a87a335e10d02ef49. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:10:22.539643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Getting quotas for user 012ead000e8d411eae7034f296455fe7 and project c040647b03574d3a87a335e10d02ef49. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:10:22.550722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:10:22.552900 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:10:22.688175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a855ff85-4854-4d52-acf2-e80a0c59568a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.142500 Aug 30 12:10:22.688945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 135/281] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:10:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 6144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 12:10:22.699716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-debfc072-16b8-4d83-9956-258448b2b5f6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:22.700347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-debfc072-16b8-4d83-9956-258448b2b5f6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:22.753782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-debfc072-16b8-4d83-9956-258448b2b5f6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:22.760688 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-debfc072-16b8-4d83-9956-258448b2b5f6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1245 microversion: 2.1 time: 0.065170 Aug 30 12:10:22.761278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 147/282] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:22 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:22.982717 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:22.984170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:22.990392 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:22.990928 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:22.991384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:22.992091 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:22.995809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:22.995809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:23.139865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:23.147989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:23.149426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:23.150610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6c4841ae-245b-4a44-a091-418b0ffdc9f4 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1740 microversion: 2.20 time: 0.172075 Aug 30 12:10:23.151179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 136/283] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:22 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:23.355103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:23.355832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:23.363609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:23.364334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:23.364911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:23.365744 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:23.366317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:23.366825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:23.498545 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:23.506634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a797d9a0-c865-4af9-ad24-e462ee8a65d2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.155485 Aug 30 12:10:23.507192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 148/284] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:23 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:23.783287 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:23.784415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:23.792665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:23.793145 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:23.793575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:23.794257 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:23.794704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:23.795124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:23.862822 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:23.870889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f6f51380-5948-4d3a-833c-29d1a077f859 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1249 microversion: 2.1 time: 0.092709 Aug 30 12:10:23.871472 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 137/285] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:23 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:24.173834 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:24.174551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:24.180701 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:24.181210 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:24.181623 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:24.182316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:24.182771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:24.183209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:24.317539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:24.326516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:24.328134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:24.329332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f7d083ad-2b3a-4bf5-8d10-8afd024c6ed3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1722 microversion: 2.20 time: 0.160408 Aug 30 12:10:24.329878 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 149/286] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:24 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:24.526564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:24.527198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:24.533412 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:24.534081 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:24.534287 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:24.534969 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:24.535417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:24.535836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:24.667368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:24.675769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dc14c6be-3096-4487-a8aa-e94d1ea8642d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.153073 Aug 30 12:10:24.676350 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 138/287] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:24 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:24.892524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:24.893135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:24.899601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:24.900112 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:24.900547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:24.901229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:24.901680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:24.902105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:24.965650 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:24.975223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9804d933-df6a-46e9-be6b-733ce4a5966a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1249 microversion: 2.1 time: 0.087088 Aug 30 12:10:24.975849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 150/288] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:24 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:25.352986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:25.353657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:25.360598 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:25.361111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:25.361548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:25.362239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:25.362682 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:25.363296 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:25.528444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:25.539437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:25.542636 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:25.546963 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d11221d0-9cd6-4828-ad46-de7f8f364e88 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1722 microversion: 2.20 time: 0.195623 Aug 30 12:10:25.546963 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 139/289] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:25 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:25.696990 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:25.697599 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:25.704436 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:25.705139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:25.716858 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:25.719740 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:25.720505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:25.725940 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:25.939664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:25.947485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bf5f64fe-f251-44ec-a662-29e7b59a549d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.254357 Aug 30 12:10:25.948073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 151/290] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:25 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:25.996126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:25.996726 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:26.002679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:26.003196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:26.003621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:26.004325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:26.004767 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:26.005181 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:26.081237 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:26.089894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4149ae61-8148-414f-9cdb-f94c1d3d85da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1297 microversion: 2.1 time: 0.097702 Aug 30 12:10:26.090547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 140/291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:25 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:26.569410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:26.570011 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:26.576520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:26.577027 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:26.577458 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:26.578139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:26.578613 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:26.579030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:26.708710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:26.716822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:26.719585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:26.720773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2cee01d4-b33b-4f65-9faa-baae2468b6d6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1722 microversion: 2.20 time: 0.156343 Aug 30 12:10:26.721329 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 152/292] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:26 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:26.970566 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:26.971796 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:26.978232 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:26.978718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:26.979179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:26.979869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:26.980404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:26.980869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:27.116493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:27.117181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:27.126806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:27.127447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:27.128005 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:27.128893 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:27.129364 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:27.130077 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:27.168936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:27.179269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e462076e-007c-4499-8168-75f175643ed0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.213348 Aug 30 12:10:27.179850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 141/293] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:26 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:27.210939 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:27.220618 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2c900a73-0c0f-478d-bcd3-8266ebc16cbb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1305 microversion: 2.1 time: 0.110338 Aug 30 12:10:27.221192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 153/294] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:27 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:27.744099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:27.745373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:27.760074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:27.760074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:27.760074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:27.760074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:27.760840 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:27.760840 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:27.897810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:27.906567 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:27.908088 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:27.909241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2eb4ed8e-bf44-4c1f-a1d9-85839a8fb062 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1722 microversion: 2.20 time: 0.169150 Aug 30 12:10:27.909796 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 142/295] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:27 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:28.201015 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:28.201696 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:28.208602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:28.209380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:28.209976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:28.210673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:28.211122 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:28.211544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:28.242714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:28.243367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:28.250623 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:28.251105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:28.251533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:28.252251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:28.254571 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:28.254571 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:28.319349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:28.323419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:28.328661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dab84d9d-e828-4a94-b39c-ba39e71a8e47 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1305 microversion: 2.1 time: 0.090555 Aug 30 12:10:28.329313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 143/296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:28 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:28.443177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-e937e8fc-43ca-4295-9626-fe9d89eb08fe req-794fb8d7-a2ec-4d09-be3f-9ebb47f20f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a615cb0-f264-420f-b63a-232ae546db71", "name": "network-vif-plugged", "status": "completed", "tag": "714eaeee-484b-4696-85eb-8974172eab61"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:28.479265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-e937e8fc-43ca-4295-9626-fe9d89eb08fe req-794fb8d7-a2ec-4d09-be3f-9ebb47f20f06 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:28.480660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-e937e8fc-43ca-4295-9626-fe9d89eb08fe req-794fb8d7-a2ec-4d09-be3f-9ebb47f20f06 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:28.483826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-e937e8fc-43ca-4295-9626-fe9d89eb08fe req-794fb8d7-a2ec-4d09-be3f-9ebb47f20f06 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:28.507424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-e937e8fc-43ca-4295-9626-fe9d89eb08fe req-794fb8d7-a2ec-4d09-be3f-9ebb47f20f06 service nova] Creating event network-vif-plugged:714eaeee-484b-4696-85eb-8974172eab61 for instance 7a615cb0-f264-420f-b63a-232ae546db71 on hv-cinder-83976 Aug 30 12:10:28.507529 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:28.511380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-e937e8fc-43ca-4295-9626-fe9d89eb08fe req-794fb8d7-a2ec-4d09-be3f-9ebb47f20f06 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075423 Aug 30 12:10:28.516831 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 144/297] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:28.523492 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d251a05c-c07e-44ad-90ee-0c89fd94ee85 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.326382 Aug 30 12:10:28.534176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 154/298] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:28 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:28.934756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:28.935276 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:28.941957 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:28.942430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:28.943234 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:28.944157 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:28.944791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:28.945388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:29.086252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:29.095233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:29.097311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:29.099165 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-df1914e6-76b3-42a7-9af3-5dfde5797641 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1725 microversion: 2.20 time: 0.168840 Aug 30 12:10:29.120627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 145/299] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:28 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:29.127662 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88486be8-9ef2-4af1-9d2a-29e05dad03bd"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:29.130448 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:29.137894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:29.139052 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:29.140093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:29.141204 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:29.141859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:29.142691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:29.351104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:29.351898 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:29.359535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:29.360141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:29.360645 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:29.361416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:29.361945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:29.362437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:29.531907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:29.540150 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a11983fe-30d3-4d7a-8db1-0838975c99eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.194216 Aug 30 12:10:29.540970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 146/300] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:29 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:29.546137 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:29.546737 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:29.552776 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:29.553480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:29.553915 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:29.554614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:29.555067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:29.555490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:29.716690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:29.726504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4a876d0c-b118-4ab7-9bed-7b56dbd6349d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1319 microversion: 2.1 time: 0.184373 Aug 30 12:10:29.735870 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 147/301] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:29 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:30.399162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-15f9ba0c-7518-4af6-a419-7412faba35fd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.276627 Aug 30 12:10:30.399813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 155/302] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Aug 30 12:10:29 2022] POST /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments => generated 188 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:10:30.416847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1273843303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1243030642", "security_groups": [{"name": "tempest-secgroup-smoke-275745598"}], "block_device_mapping_v2": [{"uuid": "b68fc449-9709-4ea1-a365-0075678cd891", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ba54cfd-b283-4e2b-b07e-a4cb404d43be"}]}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:30.438552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-1fc54e6a-7f47-4ec7-b270-7e69850f607d req-df0b8f16-34a0-44a4-b2cc-ec9de7ec6d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fea936-d2d6-4953-9ff2-34c126638e3a", "tag": "d457c16d-f375-456b-a12c-f326f04d9b62"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:30.456356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-1fc54e6a-7f47-4ec7-b270-7e69850f607d req-df0b8f16-34a0-44a4-b2cc-ec9de7ec6d30 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:30.457099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-1fc54e6a-7f47-4ec7-b270-7e69850f607d req-df0b8f16-34a0-44a4-b2cc-ec9de7ec6d30 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:30.457791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-1fc54e6a-7f47-4ec7-b270-7e69850f607d req-df0b8f16-34a0-44a4-b2cc-ec9de7ec6d30 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:30.483301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-1fc54e6a-7f47-4ec7-b270-7e69850f607d req-df0b8f16-34a0-44a4-b2cc-ec9de7ec6d30 service nova] Creating event network-changed:d457c16d-f375-456b-a12c-f326f04d9b62 for instance 38fea936-d2d6-4953-9ff2-34c126638e3a on hv-cinder-83976 Aug 30 12:10:30.489384 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-1fc54e6a-7f47-4ec7-b270-7e69850f607d req-df0b8f16-34a0-44a4-b2cc-ec9de7ec6d30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054579 Aug 30 12:10:30.490382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 156/303] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:30.532708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-fb4e7a82-9daf-4218-a011-8545bb6aef99 req-ce55e991-b8be-40d5-880e-fb807e0b87f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294a2d1c-a5ff-4f5e-945f-03a42a7800cc", "name": "network-vif-unplugged", "status": "completed", "tag": "1a156fe5-05f5-48b0-bb53-3f8c98e5846a"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:30.542423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-fb4e7a82-9daf-4218-a011-8545bb6aef99 req-ce55e991-b8be-40d5-880e-fb807e0b87f3 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:30.542896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-fb4e7a82-9daf-4218-a011-8545bb6aef99 req-ce55e991-b8be-40d5-880e-fb807e0b87f3 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:30.543323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-fb4e7a82-9daf-4218-a011-8545bb6aef99 req-ce55e991-b8be-40d5-880e-fb807e0b87f3 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:30.557273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-fb4e7a82-9daf-4218-a011-8545bb6aef99 req-ce55e991-b8be-40d5-880e-fb807e0b87f3 service nova] Creating event network-vif-unplugged:1a156fe5-05f5-48b0-bb53-3f8c98e5846a for instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc on hv-cinder-83976 Aug 30 12:10:30.562329 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-fb4e7a82-9daf-4218-a011-8545bb6aef99 req-ce55e991-b8be-40d5-880e-fb807e0b87f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034433 Aug 30 12:10:30.563306 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 157/304] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:10:30.569645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:30.570337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:30.572485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:30.578151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:30.578645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:30.579073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:30.581169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:30.581169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:30.581169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:30.633041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] validate_networks() for [('4ba54cfd-b283-4e2b-b07e-a4cb404d43be', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:10:30.742336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:30.745865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:30.751060 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d9d8d939-1819-40f4-b551-6ea09279ff39 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.186207 Aug 30 12:10:30.764692 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 158/305] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:30 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:30.773515 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:30.774484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:30.782679 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:30.783325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:30.783760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:30.784665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:30.785280 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:30.785713 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:30.834050 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121191) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 12:10:31.062444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:10:31.062444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:10:31.062888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:10:31.063284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:10:31.063686 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:10:31.078761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.079311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.079741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.080506 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.080954 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.081395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.101565 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:10:31.105804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for user 3733f8f0d14746949cbe92c9d370c33e and project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:10:31.125643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-248aa90b-b36b-4e8f-a82d-f350d2f0f4c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/action" status: 202 len: 0 microversion: 2.20 time: 0.357054 Aug 30 12:10:31.129589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 159/306] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Aug 30 12:10:30 2022] POST /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:10:31.135839 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:31.136485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:31.151162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.151662 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.152131 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.152900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.153448 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.153874 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.180014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:10:31.181372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b68fc449-9709-4ea1-a365-0075678cd891',volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:10:31.487111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:31.488880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:31.496986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0395a89a-27ae-4636-ae9e-720338f60281 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1507 microversion: 2.1 time: 0.367301 Aug 30 12:10:31.497857 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 160/307] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:31 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:31.528304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:31.528936 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:31.559219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.565760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.565760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.565760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.565760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.566551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.617943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e704615b-d082-44ac-9d64-6dbf3c337b94 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.204803 Aug 30 12:10:31.619835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 148/308] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:10:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:10:31.630325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7cc3ada9-1fb7-41c8-90dc-d5a6d4a7fc9a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:31.630956 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7cc3ada9-1fb7-41c8-90dc-d5a6d4a7fc9a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:31.736281 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:31.751882 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:31.753369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:31.753501 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7cc3ada9-1fb7-41c8-90dc-d5a6d4a7fc9a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:31.756224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4e1b4179-71e1-403c-bfdf-05928222bed8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1751 microversion: 2.20 time: 0.233042 Aug 30 12:10:31.756224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 161/309] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:31 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:31.785199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:31.785817 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7cc3ada9-1fb7-41c8-90dc-d5a6d4a7fc9a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1095 microversion: 2.1 time: 0.159466 Aug 30 12:10:31.787059 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 149/310] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:31 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1095 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:31.789489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:31.805662 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.806155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.806593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.809305 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:31.812124 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:31.814089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:31.977821 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:31.985862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9bb800fc-0ddd-43b7-bfda-d2d7b25e91ae tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.204699 Aug 30 12:10:31.986660 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 162/311] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:31 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:32.781812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:32.782965 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:32.789336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:32.789762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:32.790195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:32.790888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:32.791343 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:32.791759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:32.806922 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:32.807628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:32.810051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:32.816591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:32.817080 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:32.817509 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:32.818270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:32.818722 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:32.819151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:32.881575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:32.889589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1844b395-b4a0-400d-8ef6-0d7f18d300ac tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1145 microversion: 2.1 time: 0.086757 Aug 30 12:10:32.890158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 163/312] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:32 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:32.924331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:32.933037 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:32.934454 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:32.936182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e1232480-d297-4a97-aac6-b07608cb40a0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1751 microversion: 2.20 time: 0.158158 Aug 30 12:10:32.937001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 150/313] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:32 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:33.006867 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:33.007470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:33.013676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:33.014451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:33.014954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:33.015664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:33.016455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:33.016878 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:33.154896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:33.162485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8321f3ac-599b-40a6-a820-7a496be91a20 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.159703 Aug 30 12:10:33.163034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 164/314] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:33 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:33.910607 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:33.911207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:33.917286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:33.917760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:33.918181 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:33.918849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:33.919291 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:33.919702 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:33.958754 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:33.959395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:33.965760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:33.966239 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:33.966665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:33.967851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:33.968325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:33.968743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:33.979657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:33.987890 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-09840d80-0c46-4ccb-bb94-37864636a4fd tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1145 microversion: 2.1 time: 0.081065 Aug 30 12:10:33.988484 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 151/315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:33 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:34.151332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:34.162101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:34.163456 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:34.165805 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-020583f2-33bc-4c09-b225-5c00e2239b16 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1751 microversion: 2.20 time: 0.210207 Aug 30 12:10:34.166157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 165/316] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:33 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:34.184283 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:34.185073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:34.193321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:34.193801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:34.194227 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:34.194903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:34.195344 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:34.195921 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:34.346624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:34.362056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-13a8e005-4075-40f0-a8cb-c4ef7a51e92c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.181899 Aug 30 12:10:34.363007 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 152/317] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:34 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:35.009113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:35.009749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:35.017354 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:35.017844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:35.018277 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:35.018973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:35.019424 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:35.019980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:35.083099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:35.090753 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c60df7c9-cd74-4697-890b-9569e44c08ed tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1193 microversion: 2.1 time: 0.086197 Aug 30 12:10:35.091334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 166/318] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:35 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:35.189255 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:35.189856 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:35.196175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:35.196659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:35.197203 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:35.197887 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:35.198337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:35.198756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:35.334416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:35.343160 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:35.344935 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:35.346196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b80e2f1b-5e58-4b0d-aee3-58537fda7441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1753 microversion: 2.20 time: 0.161257 Aug 30 12:10:35.346754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 153/319] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:35 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:35.384250 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:35.384925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:35.391750 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:35.392251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:35.392681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:35.393480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:35.393928 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:35.394346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:35.531348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:35.539671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f35f3a4b-292f-4d96-851f-6648fb7e483c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.159391 Aug 30 12:10:35.540732 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 167/320] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:35 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:36.113230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:36.114155 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:36.121572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:36.122062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:36.122495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:36.123905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:36.124408 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:36.124859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:36.188079 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:36.196511 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f02c0740-914e-4b35-af18-19438fb98c42 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1193 microversion: 2.1 time: 0.087796 Aug 30 12:10:36.197148 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 154/321] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:36 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:36.370427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:36.370976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:36.378188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:36.378664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:36.379093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:36.379795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:36.380252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:36.380669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:36.517278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:36.527576 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:36.529057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:36.530275 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7cdfaf89-cd46-4658-89f3-86a403ce39e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1753 microversion: 2.20 time: 0.163885 Aug 30 12:10:36.530824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 168/322] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:36 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:36.563044 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:36.563809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:36.570094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:36.570577 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:36.570999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:36.571733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:36.572203 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:36.572618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:36.713122 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:36.721302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6602981b-a0b7-49a8-97fe-b670dba8fb88 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.164167 Aug 30 12:10:36.721866 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 155/323] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:36 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:37.219385 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:37.220018 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:37.226524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:37.227007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:37.227438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:37.228151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:37.228636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:37.229057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:37.293693 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:37.301433 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-14b5681e-85fa-468f-8fd4-92a2621d6250 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1193 microversion: 2.1 time: 0.087211 Aug 30 12:10:37.301984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 169/324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:37 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:37.553286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:37.554062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:37.560198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:37.560715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:37.561140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:37.561810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:37.562259 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:37.562666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:37.700136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:37.708728 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:37.710220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:37.711412 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5425f8b9-26d1-41fe-a571-352be74a5bb8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1753 microversion: 2.20 time: 0.162071 Aug 30 12:10:37.711981 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 156/325] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:37 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:37.743140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:37.743741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:37.753651 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:37.754147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:37.755661 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:37.756440 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:37.756976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:37.757427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:37.892953 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:37.900571 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3bd7b11c-ecc3-4c1a-bbb3-56c5a6b5947e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.161723 Aug 30 12:10:37.901136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 170/326] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:37 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:38.321845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:38.322453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:38.328605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:38.329090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:38.329526 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:38.330207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:38.330662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:38.331085 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:38.397281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:38.405605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8c420a66-362c-4e26-ac11-ceed992fe984 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1193 microversion: 2.1 time: 0.087545 Aug 30 12:10:38.406204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 157/327] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:38 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:38.734920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:38.735531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:38.741408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:38.741890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:38.742326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:38.743014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:38.748141 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:38.748141 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:38.875564 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:38.884326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:38.885753 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:38.886892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-70fa4d3d-0991-45bd-b645-82ddd0aa023b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1753 microversion: 2.20 time: 0.156244 Aug 30 12:10:38.887438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 171/328] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:38 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:38.921597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:38.922138 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:38.927931 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:38.928436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:38.928859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:38.929528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:38.929971 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:38.930384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:39.065554 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:39.073147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e13f7b34-41aa-4e2c-b41f-47ad32154643 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.155747 Aug 30 12:10:39.073691 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 158/329] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:38 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:39.427126 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:39.427733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:39.433944 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:39.434423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:39.434852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:39.435530 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:39.436001 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:39.436420 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:39.501088 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:39.509263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8c4732f1-f384-4187-9d08-5c1509e5010d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1193 microversion: 2.1 time: 0.086086 Aug 30 12:10:39.509953 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 172/330] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:39 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:39.910999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:39.911717 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:39.919201 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:39.919747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:39.920136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:39.920828 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:39.922044 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:39.922678 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:40.080198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:40.090469 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:40.092035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:40.094595 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1b645621-a3f1-483e-a606-eebf511eff33 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.187248 Aug 30 12:10:40.101091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:40.101575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 159/331] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:39 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:40.101672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:40.104361 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:40.104914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:40.105700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:40.106667 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:40.108258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:40.108874 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:40.331003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:40.339129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dd97f611-282c-4439-b2d0-a63d54d66a9a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.248655 Aug 30 12:10:40.339896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 173/332] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:40 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:40.536216 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:40.537316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:40.543253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:40.543735 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:40.544198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:40.544892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:40.545336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:40.545785 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:40.608246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:40.616629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e3ab3798-e84d-4786-ab58-fa6270834289 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1211 microversion: 2.1 time: 0.085239 Aug 30 12:10:40.617187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 160/333] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:40 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:41.118779 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:41.119580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:41.126041 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:41.126527 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:41.126958 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:41.127649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:41.128217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:41.128672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:41.148199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:41.263701 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:41.273573 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:41.275024 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:41.276235 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-250db7be-630b-49e2-9fe7-a02093e9d1c8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.161455 Aug 30 12:10:41.276792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 174/334] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:41 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:41.361048 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:41.361597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:41.363499 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=4 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:41.368371 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:41.368844 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:41.369375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:41.372430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:41.372430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:41.372430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:41.503177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:41.510810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-eaa8776d-f494-47c3-816f-10ce5ca32f82 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.154256 Aug 30 12:10:41.511364 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 161/335] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:41 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:41.637602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:41.638124 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:41.645291 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:41.645775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:41.646206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:41.646894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:41.647353 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:41.647774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:41.781581 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:41.789136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-53d55c80-0a35-4a78-a4a9-21cdb8a5b912 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1278 microversion: 2.1 time: 0.155461 Aug 30 12:10:41.789695 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 175/336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:41 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:42.299317 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:42.300048 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:42.301947 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=14 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:42.306617 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:42.307087 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:42.307509 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:42.308210 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:42.308649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:42.309057 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:42.442874 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:42.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:42.451600 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:42.453292 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:42.454498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2fbf85a1-b700-444d-a7c3-0cc675f4935c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.159688 Aug 30 12:10:42.455041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 162/337] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:42 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:42.531628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:42.532267 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:42.538657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:42.539139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:42.539599 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:42.540316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:42.540777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:42.541205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:42.682911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:42.690721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ef16c7a4-8b5a-4055-a2c5-8df98271e3a0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.162817 Aug 30 12:10:42.691680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 176/338] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:42 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:42.813029 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:42.813633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:42.820227 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:42.820706 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:42.821140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:42.821816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:42.822265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:42.822684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:42.959611 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:42.967902 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c350fb18-f2f4-4d73-8e8f-a4c164398b1b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1278 microversion: 2.1 time: 0.159399 Aug 30 12:10:42.968696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 163/339] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:42 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:43.477423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:43.478194 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:43.484987 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:43.485508 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:43.486727 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:43.487601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:43.488121 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:43.488554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:43.665860 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-20afd4ee-ac5b-4e1f-ab55-69dc89e75a2d req-d5131568-844a-45f4-b908-836ac63a2cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fea936-d2d6-4953-9ff2-34c126638e3a", "name": "network-vif-plugged", "status": "completed", "tag": "d457c16d-f375-456b-a12c-f326f04d9b62"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:43.677129 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-20afd4ee-ac5b-4e1f-ab55-69dc89e75a2d req-d5131568-844a-45f4-b908-836ac63a2cf7 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:43.677597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-20afd4ee-ac5b-4e1f-ab55-69dc89e75a2d req-d5131568-844a-45f4-b908-836ac63a2cf7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:43.678018 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-20afd4ee-ac5b-4e1f-ab55-69dc89e75a2d req-d5131568-844a-45f4-b908-836ac63a2cf7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:43.690230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-20afd4ee-ac5b-4e1f-ab55-69dc89e75a2d req-d5131568-844a-45f4-b908-836ac63a2cf7 service nova] Creating event network-vif-plugged:d457c16d-f375-456b-a12c-f326f04d9b62 for instance 38fea936-d2d6-4953-9ff2-34c126638e3a on hv-cinder-83976 Aug 30 12:10:43.695753 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-20afd4ee-ac5b-4e1f-ab55-69dc89e75a2d req-d5131568-844a-45f4-b908-836ac63a2cf7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Aug 30 12:10:43.696732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 164/340] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:10:43.712790 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:43.713569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:43.721028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:43.721592 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:43.722082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:43.722829 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:43.723342 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:43.723757 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:43.786201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:43.800229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:43.808364 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:43.809694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b76bc568-6353-41aa-86e1-5c70373b9c4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.336437 Aug 30 12:10:43.825432 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 177/341] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:43 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:43.908761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:43.917696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-09861647-4039-4ad2-a255-254e14e6741c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.209086 Aug 30 12:10:43.932845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 165/342] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:43 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:43.989269 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:43.989948 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:43.996164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:43.996655 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:43.997088 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:44.001501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:44.001501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:44.001501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:44.327642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:44.336298 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-24c50948-12af-4e34-af5f-14c1f1c5fabe tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1278 microversion: 2.1 time: 0.350908 Aug 30 12:10:44.356292 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 178/343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:43 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1278 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:44.769124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-bd7198e5-6a44-41cb-bd5b-e0a444ae9e6c req-2b7fce4d-bb7f-4222-85f5-a30bee8fbc07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423f83c5-b199-43bd-a57f-0c208ac1c44e", "tag": "365df129-d1af-439d-a5be-0382853d90e2"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:44.769124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-bd7198e5-6a44-41cb-bd5b-e0a444ae9e6c req-2b7fce4d-bb7f-4222-85f5-a30bee8fbc07 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:44.769124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-bd7198e5-6a44-41cb-bd5b-e0a444ae9e6c req-2b7fce4d-bb7f-4222-85f5-a30bee8fbc07 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:44.769124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-bd7198e5-6a44-41cb-bd5b-e0a444ae9e6c req-2b7fce4d-bb7f-4222-85f5-a30bee8fbc07 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:44.778401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-bd7198e5-6a44-41cb-bd5b-e0a444ae9e6c req-2b7fce4d-bb7f-4222-85f5-a30bee8fbc07 service nova] Creating event network-changed:365df129-d1af-439d-a5be-0382853d90e2 for instance 423f83c5-b199-43bd-a57f-0c208ac1c44e on hv-cinder-83976 Aug 30 12:10:44.785348 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-bd7198e5-6a44-41cb-bd5b-e0a444ae9e6c req-2b7fce4d-bb7f-4222-85f5-a30bee8fbc07 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035439 Aug 30 12:10:44.786595 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 166/344] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:44.843368 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:44.843368 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:44.847901 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:44.848423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:44.848857 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:44.849550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:44.850007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:44.850439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:44.940421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:44.941278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:44.947801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:44.948390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:44.949158 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:44.949647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:44.950227 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:44.950710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:44.997141 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:45.006408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:45.007868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:45.009326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5f210c3f-418c-4ed1-8a9b-c1ea520bcd0a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.173141 Aug 30 12:10:45.009888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 179/345] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:44 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:45.114559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:45.125564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ddde0f85-8531-47a7-88d8-5de790dd746a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1370 microversion: 2.1 time: 0.189964 Aug 30 12:10:45.126224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 167/346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:44 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:45.358302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:45.358922 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:45.365124 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:45.365604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:45.366037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:45.366728 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:45.367180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:45.367603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:45.502548 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:45.511169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b607919e-ff97-4bad-9879-4971a8dcdcd5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1278 microversion: 2.1 time: 0.156709 Aug 30 12:10:45.511722 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 180/347] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:45 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:46.032514 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:46.033094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:46.039209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.039716 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.040200 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.040887 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.041341 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.041763 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.147024 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:46.147730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:46.154343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.154756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.155181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.156452 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.156912 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.157472 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.170872 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:46.180337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:46.181783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:46.182957 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d96fba34-0524-4fe3-8f4b-37fe29ea73da tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.154298 Aug 30 12:10:46.183505 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 168/348] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:46 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:46.294050 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:46.303004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-805e5279-14b8-4f79-8696-aaeb90b72cea tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1564 microversion: 2.1 time: 0.159529 Aug 30 12:10:46.320435 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 181/349] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:46 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:46.325691 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:46.326268 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:46.342365 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.342745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.343188 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.345277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.345731 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.346156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.477811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c6a7c911-043f-47b8-a318-b409f9b15f49 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156512 Aug 30 12:10:46.486345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 169/350] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:10:46 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:10:46.535345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:46.536509 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:46.543673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.544451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.545137 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.545879 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:46.547201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:46.547805 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:46.791000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:46.800359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fa2f73bc-1073-4660-ad5e-540faa7caab7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1278 microversion: 2.1 time: 0.270695 Aug 30 12:10:46.800930 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 182/351] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:46 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1278 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:47.207355 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:47.207985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:47.214429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:47.215217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:47.215854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:47.216784 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:47.217382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:47.218071 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:47.535067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:47.546212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:47.548868 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:47.555621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0baa5115-deb3-4894-a603-c2e1743461f0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.347343 Aug 30 12:10:47.555621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 170/352] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:47 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:47.822645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:47.823554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:47.831356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:47.832441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:47.833345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:47.834330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:47.835004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:47.835916 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:47.999849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:48.009711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ad03455f-7a2e-4e05-8ffa-40824403ee5b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.191247 Aug 30 12:10:48.011046 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 183/353] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:47 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:48.124157 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-64bf4d33-798c-4c5e-b1cf-ceac6c63946e req-6c1521bd-5abe-4a77-8f79-2ee7a21815d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fea936-d2d6-4953-9ff2-34c126638e3a", "tag": "d457c16d-f375-456b-a12c-f326f04d9b62"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:48.135208 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-64bf4d33-798c-4c5e-b1cf-ceac6c63946e req-6c1521bd-5abe-4a77-8f79-2ee7a21815d1 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:48.136229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-64bf4d33-798c-4c5e-b1cf-ceac6c63946e req-6c1521bd-5abe-4a77-8f79-2ee7a21815d1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:48.136784 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-64bf4d33-798c-4c5e-b1cf-ceac6c63946e req-6c1521bd-5abe-4a77-8f79-2ee7a21815d1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:48.150328 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-64bf4d33-798c-4c5e-b1cf-ceac6c63946e req-6c1521bd-5abe-4a77-8f79-2ee7a21815d1 service nova] Creating event network-changed:d457c16d-f375-456b-a12c-f326f04d9b62 for instance 38fea936-d2d6-4953-9ff2-34c126638e3a on hv-cinder-83976 Aug 30 12:10:48.157284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-64bf4d33-798c-4c5e-b1cf-ceac6c63946e req-6c1521bd-5abe-4a77-8f79-2ee7a21815d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038913 Aug 30 12:10:48.157881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 171/354] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:48.581157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:48.582317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:48.590238 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:48.591073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:48.591711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:48.592749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:48.594607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:48.595302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:48.815219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:48.825307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:48.827549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:48.829551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f21a1416-8bfa-44bb-a100-99bbc170c20d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.257627 Aug 30 12:10:48.830458 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 184/355] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:48 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:49.034016 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:49.034974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:49.047297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:49.049352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:49.049352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:49.050356 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:49.050990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:49.052129 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:49.261477 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:49.270444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4b92c28c-1ea3-4591-8c98-b887cf622e16 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.241733 Aug 30 12:10:49.283997 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 172/356] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:49 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:49.856714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:49.862736 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:49.866270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:49.866766 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:49.867278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:49.868101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:49.868559 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:49.869278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:50.029589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:50.040673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:50.042611 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:50.044170 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ac462c84-98b7-4489-97a2-db7a2571d79a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.191205 Aug 30 12:10:50.044745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 185/357] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:49 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:50.299295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:50.300028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:50.307462 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:50.308117 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:50.308553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:50.309260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:50.309704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:50.310126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:50.632036 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:50.641053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-627555ff-6b38-413f-8f4e-127ff245eef8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.349092 Aug 30 12:10:50.641780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 173/358] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:50 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:51.076403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:51.079641 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:51.087132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:51.092822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:51.092822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:51.092822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:51.092822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:51.093426 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:51.290151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:51.300557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:51.302316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:51.303485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-02d80fbf-fb16-4cfc-b8c4-7301edf5af36 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.232133 Aug 30 12:10:51.304059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 186/359] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:51 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:51.668515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:51.669120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:51.676925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:51.677524 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:51.678029 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:51.679124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:51.679727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:51.680251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:51.825857 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:51.827079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:51.838214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:51.841365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:51.847814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:51.848911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:51.849535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:51.850131 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:51.876188 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:51.884382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-133caa38-e421-42d8-a79d-f3ebc2269b2b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/ips" status: 200 len: 145 microversion: 2.1 time: 0.062982 Aug 30 12:10:51.890899 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5d65d7b0-ae83-4133-86f7-0aabf932418d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.226195 Aug 30 12:10:51.892008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 187/360] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:10:51 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/ips => generated 145 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:10:51.892569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 174/361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:51 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:52.328188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:52.329932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:52.337314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:52.337910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:52.338418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:52.339199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:52.339744 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:52.340272 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:52.490955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:52.500132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:52.501483 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:52.502650 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e8882c53-83ab-462a-8d75-e05ed84b45e0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.178672 Aug 30 12:10:52.503205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 188/362] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:52 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:52.768869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e27ab6fe-53ed-4d0d-bfbd-469ba0da0f97", "device": "/dev/sdb"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:52.772120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:52.779140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:52.779612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:52.780069 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:52.780975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:52.781425 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:52.781847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:52.917976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:52.919057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:52.926149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:52.926632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:52.927062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:52.927894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:52.928376 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:52.928793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:53.091185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:53.104757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3a459ab4-5ffa-4ebd-8d35-8b55ae9f1db4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.192468 Aug 30 12:10:53.119933 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 189/363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:52 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:53.527528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:53.528269 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:53.535338 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:53.535824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:53.536295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:53.536984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:53.537441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:53.537868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:53.715380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:53.730192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:53.732002 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:53.734473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f3a6b73b-aca2-40d8-bfad-b79038ce85e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.210511 Aug 30 12:10:53.736650 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 190/364] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:53 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:10:54.127455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:54.128118 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:54.134214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:54.134701 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:54.135132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:54.135821 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:54.136460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:54.136886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:54.155237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:10:54.283233 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:54.292977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a870e0d6-49ed-4e54-99fb-f1f5104e0aa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.169766 Aug 30 12:10:54.293630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 191/365] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:54 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:10:54.725290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62fb27f4-0fc5-41a1-bc71-5e508b38cc0a"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:10:54.727719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:54.734908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:54.735386 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:54.735816 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:54.736544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:54.737066 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:54.737560 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:57.996231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fde8cf5a-4502-4533-a5e5-f6293ba733c9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.274740 Aug 30 12:10:57.996989 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 192/366] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:10:54 2022] POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-volume_attachments => generated 194 bytes in 3276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:10:58.002181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:58.002988 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:58.009179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:58.009658 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:58.010087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:58.010764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:58.011212 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:58.011625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:58.049300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7f0de79a-2c60-4fd2-acd4-730d798f0d27 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "POST /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.284775 Aug 30 12:10:58.051636 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 175/367] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:10:52 2022] POST /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71/os-volume_attachments => generated 194 bytes in 5286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:10:58.062305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:58.062305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:58.063615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:58.066372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:58.066888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:58.067891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:58.068450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:58.068882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:58.213035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:58.221994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bd38de1f-6003-4935-8d6a-b7f9174dbb2e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.170829 Aug 30 12:10:58.222561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 176/368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:58 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:58.260423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:58.270329 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:58.271854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:58.273106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-976640bf-bb4d-41a7-a041-581712c28b42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.275069 Aug 30 12:10:58.273759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 193/369] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:57 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:10:59.242730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:59.243666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:59.250155 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:59.250633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:59.251055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:59.251741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:59.252213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:59.252625 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:59.296616 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:10:59.297169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:10:59.304715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:59.305470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:59.306063 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:59.306923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:10:59.307376 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:10:59.307789 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:10:59.395699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:59.403449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9b06f633-88e6-4b54-bd67-54a89f73d40a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.164626 Aug 30 12:10:59.404005 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 177/370] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:10:59 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:10:59.883306 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:59.894945 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:59.896356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:10:59.897544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-03bf485a-c6ac-4095-90f4-9c0017ce2b8c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.605038 Aug 30 12:10:59.898100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 194/371] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:10:59 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:11:00.426422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:00.426960 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:00.433343 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:00.433825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:00.434258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:00.434945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:00.435396 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:00.435816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:00.568916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:00.576548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b91d2ae2-ff97-45e7-82b0-8de123de036d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.154992 Aug 30 12:11:00.577129 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 178/372] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:00 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:00.920360 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:00.921676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:00.928270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:00.928603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:00.929034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:00.929726 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:00.930162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:00.930610 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:01.065922 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:01.074967 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:01.076455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:01.078244 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5f3bddfb-3c9b-472b-bea8-6dcd0d7e7924 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.161696 Aug 30 12:11:01.079004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 195/373] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:00 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:01.599209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:01.600034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:01.607040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:01.607557 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:01.608014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:01.609335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:01.609788 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:01.610210 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:01.753441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:01.761226 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-052be9bc-3a36-44da-b50d-3be00f3e3d03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.166427 Aug 30 12:11:01.761779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 179/374] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:01 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:02.103222 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:02.103822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:02.106286 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:02.111378 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:02.112029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:02.112584 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:02.113386 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:02.113999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:02.114606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:02.246159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:02.255345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:02.256885 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:02.257974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-850ceb61-a6ef-4e79-b01a-46e363366757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.158639 Aug 30 12:11:02.258685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 196/375] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:02 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:02.781794 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:02.782406 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:02.789125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:02.789630 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:02.790052 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:02.790724 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:02.791170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:02.791610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:02.809887 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:02.927058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:02.934478 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b466876f-7850-4f94-bb2c-6fd78ff33831 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.156645 Aug 30 12:11:02.935024 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 180/376] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:02 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:03.282166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:03.282808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:03.289294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:03.289769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:03.290196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:03.290869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:03.291318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:03.291735 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:03.432071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:03.440668 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:03.442110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:03.443257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-be7bf19d-80d9-40e9-8fc6-dac55fb549ee tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.165742 Aug 30 12:11:03.443808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 197/377] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:03 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:03.710278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-a2d247ff-b5b6-4e67-8cf6-d5e05cf41ee7 req-b1a08ff8-8d2b-468d-b9bc-80e1dd372ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423f83c5-b199-43bd-a57f-0c208ac1c44e", "name": "network-vif-plugged", "status": "completed", "tag": "365df129-d1af-439d-a5be-0382853d90e2"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:03.715257 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=67 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:03.720651 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-a2d247ff-b5b6-4e67-8cf6-d5e05cf41ee7 req-b1a08ff8-8d2b-468d-b9bc-80e1dd372ee6 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:03.721121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-a2d247ff-b5b6-4e67-8cf6-d5e05cf41ee7 req-b1a08ff8-8d2b-468d-b9bc-80e1dd372ee6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:03.721544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-a2d247ff-b5b6-4e67-8cf6-d5e05cf41ee7 req-b1a08ff8-8d2b-468d-b9bc-80e1dd372ee6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:03.732411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-a2d247ff-b5b6-4e67-8cf6-d5e05cf41ee7 req-b1a08ff8-8d2b-468d-b9bc-80e1dd372ee6 service nova] Creating event network-vif-plugged:365df129-d1af-439d-a5be-0382853d90e2 for instance 423f83c5-b199-43bd-a57f-0c208ac1c44e on hv-cinder-83976 Aug 30 12:11:03.737723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-a2d247ff-b5b6-4e67-8cf6-d5e05cf41ee7 req-b1a08ff8-8d2b-468d-b9bc-80e1dd372ee6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036715 Aug 30 12:11:03.738295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 181/378] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:11:03.955914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:03.956468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:03.962558 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:03.963040 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:03.963477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:03.964193 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:03.964648 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:03.965069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:04.110924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:04.118730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-41f50ad7-48c0-43b3-80f4-cf7faf858c1f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.167594 Aug 30 12:11:04.119304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 198/379] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:03 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:04.467723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:04.468793 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:04.475037 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:04.475520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:04.475976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:04.476657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:04.477112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:04.477534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:04.610005 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:04.618486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:04.619924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:04.621093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b50303da-a99e-4765-8252-46004fae3d96 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.158325 Aug 30 12:11:04.621642 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 182/380] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:04 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:05.141023 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:05.141633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:05.148179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:05.148669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:05.149107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:05.149798 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:05.150272 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:05.150700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:05.310078 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:05.318418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c91f7b92-f30f-4a41-b227-df6d1d68244b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.181726 Aug 30 12:11:05.318989 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 199/381] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:05 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:05.645419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:05.645960 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:05.652744 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:05.653234 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:05.653693 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:05.654412 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:05.654865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:05.655289 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:05.790136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:05.799404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:05.800857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:05.801995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bb21521f-d90b-4ccb-b887-28ca36ca58e7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.162099 Aug 30 12:11:05.802542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 183/382] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:05 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:06.338806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:06.339365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:06.346105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:06.346579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:06.347006 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:06.347680 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:06.348171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:06.348591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:06.478481 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:06.487000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c2dcbfeb-d83c-4771-a6c8-4833ac5f9f5a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.152099 Aug 30 12:11:06.487555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 200/383] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:06 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:06.825271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:06.825869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:06.832618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:06.833152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:06.833589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:06.834271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:06.834719 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:06.835136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:06.969609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:06.978485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:06.982663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:06.982663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6523f947-3725-4e2d-8486-500c1aaa61b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.159674 Aug 30 12:11:06.982663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 184/384] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:06 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:07.507765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:07.508418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:07.514733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:07.515418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:07.515880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:07.516582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:07.517032 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:07.517457 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:07.668794 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:07.672256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a82a85b5-44c8-4924-ab18-351d036e73f3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:07.678339 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fbc75719-338a-4b3c-b620-c8c8312f95f1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1266 microversion: 2.1 time: 0.174301 Aug 30 12:11:07.678606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a82a85b5-44c8-4924-ab18-351d036e73f3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:07.679096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a82a85b5-44c8-4924-ab18-351d036e73f3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:07.679517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a82a85b5-44c8-4924-ab18-351d036e73f3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:07.692473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 201/385] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:07 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:07.748609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a82a85b5-44c8-4924-ab18-351d036e73f3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Going to try to stop instance {{(pid=121192) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 12:11:07.944130 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a82a85b5-44c8-4924-ab18-351d036e73f3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action" status: 202 len: 0 microversion: 2.1 time: 0.276287 Aug 30 12:11:07.945118 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 185/386] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:11:07 2022] POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:11:07.954426 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:07.955342 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:07.962284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:07.962786 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:07.963214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:07.963910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:07.964393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:07.964819 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:08.005551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:08.006194 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:08.012501 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:08.012970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:08.013403 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:08.014143 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:08.015148 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:08.015578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:08.106738 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:08.116066 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-71f90e4c-430a-48f6-a149-3c96540453b3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.166273 Aug 30 12:11:08.116644 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 202/387] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:07 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:08.161436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:08.169938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:08.172178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:08.173353 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5070d606-372a-49a3-96df-9166e617ffa3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.172148 Aug 30 12:11:08.173907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 186/388] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:07 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:08.700191 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:08.700191 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:08.706724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:08.707209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:08.707675 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:08.708393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:08.708868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:08.709277 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:08.841551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:08.849475 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-acb704dc-2199-4186-b4c8-d77dd4df848f tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1453 microversion: 2.1 time: 0.154273 Aug 30 12:11:08.850028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 203/389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:08 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:08.870207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:08.870814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:08.877835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:08.878324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:08.878759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:08.879445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:08.879897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:08.880351 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:09.011719 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:09.019593 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-de882b6d-cbd6-402b-91c8-e92de0bb4514 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1453 microversion: 2.1 time: 0.153218 Aug 30 12:11:09.020176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 187/390] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:08 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:09.137355 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:09.137966 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:09.144122 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:09.144609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:09.145044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:09.145729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:09.146181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:09.146602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:09.196767 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:09.197368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:09.203266 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:09.203748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:09.205382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:09.205382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:09.205382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:09.205848 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:09.327799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:09.336358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b1ba2521-325b-4045-8f4f-7a488f690cff tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.202751 Aug 30 12:11:09.337029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 204/391] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:09 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:09.341633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:09.351236 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:09.352723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:09.353864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cfc46104-5da6-4c46-a1cd-695d613b615f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.160932 Aug 30 12:11:09.354410 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 188/392] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:09 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:11:09.704867 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-18571dca-8cef-44ec-bfd7-97ab42af0c64 req-21bd1f10-c623-4f0f-b476-1b3bcfb48674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294a2d1c-a5ff-4f5e-945f-03a42a7800cc", "name": "network-vif-plugged", "status": "completed", "tag": "1a156fe5-05f5-48b0-bb53-3f8c98e5846a"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:09.714784 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-18571dca-8cef-44ec-bfd7-97ab42af0c64 req-21bd1f10-c623-4f0f-b476-1b3bcfb48674 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:09.715255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-18571dca-8cef-44ec-bfd7-97ab42af0c64 req-21bd1f10-c623-4f0f-b476-1b3bcfb48674 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:09.715722 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-18571dca-8cef-44ec-bfd7-97ab42af0c64 req-21bd1f10-c623-4f0f-b476-1b3bcfb48674 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:09.727669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-18571dca-8cef-44ec-bfd7-97ab42af0c64 req-21bd1f10-c623-4f0f-b476-1b3bcfb48674 service nova] Creating event network-vif-plugged:1a156fe5-05f5-48b0-bb53-3f8c98e5846a for instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc on hv-cinder-83976 Aug 30 12:11:09.732690 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-18571dca-8cef-44ec-bfd7-97ab42af0c64 req-21bd1f10-c623-4f0f-b476-1b3bcfb48674 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Aug 30 12:11:09.733830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 205/393] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:11:10.358742 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:10.359917 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:10.366349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:10.366843 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:10.367275 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:10.368005 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:10.368472 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:10.368889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:10.377500 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:10.380705 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:10.385371 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:10.386086 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:10.386528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:10.387394 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:10.387864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:10.388310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:10.509357 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:10.518116 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a730ae44-aff9-4efb-973e-f339ff7ed00b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.163257 Aug 30 12:11:10.518681 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 189/394] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:10 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:10.657889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:10.671373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:10.673591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:10.674351 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e30bce2e-91ce-4970-a68c-69835670e19a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.302484 Aug 30 12:11:10.674918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 206/395] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:10 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:11.314571 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-2bf1c41f-222a-4186-9598-78c9f937ebde req-abc350ce-dd66-4731-a86c-cd861594e71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423f83c5-b199-43bd-a57f-0c208ac1c44e", "tag": "365df129-d1af-439d-a5be-0382853d90e2"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:11.324209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2bf1c41f-222a-4186-9598-78c9f937ebde req-abc350ce-dd66-4731-a86c-cd861594e71c service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:11.324809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2bf1c41f-222a-4186-9598-78c9f937ebde req-abc350ce-dd66-4731-a86c-cd861594e71c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:11.325301 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2bf1c41f-222a-4186-9598-78c9f937ebde req-abc350ce-dd66-4731-a86c-cd861594e71c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:11.336827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-2bf1c41f-222a-4186-9598-78c9f937ebde req-abc350ce-dd66-4731-a86c-cd861594e71c service nova] Creating event network-changed:365df129-d1af-439d-a5be-0382853d90e2 for instance 423f83c5-b199-43bd-a57f-0c208ac1c44e on hv-cinder-83976 Aug 30 12:11:11.341917 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-2bf1c41f-222a-4186-9598-78c9f937ebde req-abc350ce-dd66-4731-a86c-cd861594e71c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031156 Aug 30 12:11:11.343531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 190/396] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:11:11.538783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:11.539399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:11.545944 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:11.546712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:11.547143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:11.547836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:11.548319 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:11.548739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:11.567783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:11.683142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:11.694126 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-db1d5982-81bd-45f4-abc7-09b26c432787 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.159261 Aug 30 12:11:11.694700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 207/397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:11 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:11:11.705533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:11.706272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:11.712785 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:11.713269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:11.714580 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:11.714580 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:11.714845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:11.715434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:11.854464 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:11.864702 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:11.866139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:11.867318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-feaf6cc0-912c-422a-94dc-29411b378bfb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.166098 Aug 30 12:11:11.868256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 191/398] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:11 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:11:12.716276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:12.716883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:12.724448 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:12.724926 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:12.725355 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:12.726177 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:12.726513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:12.726924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:12.892531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:12.893141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:12.899654 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:12.900182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:12.900618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:12.901311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:12.901769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:12.902194 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:12.912182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:12.922986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d4e04b47-e209-45cd-9225-314c5909ec88 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.209620 Aug 30 12:11:12.940696 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 208/399] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:12 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:13.066676 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:13.076434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:13.078278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:13.079643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bd4b1f91-569b-43b1-b576-d6e211ddaff8 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1809 microversion: 2.20 time: 0.191100 Aug 30 12:11:13.080234 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 192/400] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:12 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:11:13.946860 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:13.947465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:13.954489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:13.954959 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:13.955381 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:13.956087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:13.956537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:13.956955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:14.086657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:14.095997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-28907b2e-d295-41b6-adf5-e433d1a8401a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.153040 Aug 30 12:11:14.096856 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 209/401] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:13 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:14.102803 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:14.103409 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:14.110461 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:14.110946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:14.111379 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:14.112097 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:14.112549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:14.112968 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:14.243569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:14.252263 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:14.253702 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:14.254847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b6333efa-3829-4ad0-b2be-fbbfacb52f6e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1796 microversion: 2.20 time: 0.155911 Aug 30 12:11:14.255401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 193/402] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:11:14 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:11:15.117139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:15.118796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:15.125921 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:15.126400 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:15.126830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:15.127519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:15.128014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:15.128462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:15.263003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:15.271228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7ef9322b-4726-48b8-9a85-9c2b7a94666e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.158390 Aug 30 12:11:15.271795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 210/403] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:15 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:16.292102 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:16.292933 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:16.300120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:16.300614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:16.301042 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:16.301747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:16.302201 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:16.302617 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:16.459659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:16.469035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-46a0b14d-b8b5-46fe-a187-134c0ff4e101 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.180858 Aug 30 12:11:16.469596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 194/404] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:16 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:17.489279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:17.489887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:17.496320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:17.496801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:17.497232 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:17.497916 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:17.498894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:17.499499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:17.625714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:17.633852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fa48b491-eea4-4303-9206-79e13767f4ae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.148460 Aug 30 12:11:17.634418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 211/405] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:17 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:18.656509 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:18.657113 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:18.663539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:18.664048 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:18.664487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:18.665166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:18.665616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:18.666031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:18.802009 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:18.810126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9db25d55-94bf-4303-a269-3bd95a2134f6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.158187 Aug 30 12:11:18.810682 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 195/406] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:18 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:19.834865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:19.835419 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:19.841811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:19.843184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:19.843615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:19.844314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:19.844761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:19.845176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:19.976238 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:19.985331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-05bce40f-1cfa-442c-8f41-bb3460627a86 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.154479 Aug 30 12:11:19.985897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 212/407] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:19 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:21.007731 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:21.008381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:21.014971 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:21.015457 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:21.015896 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:21.016613 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:21.017067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:21.017494 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:21.151607 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:21.160439 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0dd5ea1b-53b4-4351-9fba-f16e4597cf62 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.156507 Aug 30 12:11:21.160991 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 196/408] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:21 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:11:22.182106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:22.182772 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:22.189463 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:22.189943 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:22.190374 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:22.191057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:22.191515 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:22.191939 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:22.322865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:22.331531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5febbf10-5d6a-4f59-a40b-ecef06aa44c5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.153311 Aug 30 12:11:22.332126 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 213/409] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:22 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:23.353025 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:23.353565 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:23.356170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 12:11:23.356317 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Tue Aug 30 12:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 (ip 10.222.0.42) !!! Aug 30 12:11:23.366988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:23.367467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:23.367894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:23.368599 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:23.369049 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:23.369468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:23.387904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:23.500444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:23.508878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4b4b3d00-a358-47ca-82e4-0d9b50234704 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.159688 Aug 30 12:11:23.509438 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 197/410] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:23 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:24.530619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:24.531245 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:24.538369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:24.538854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:24.539285 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:24.539993 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:24.540450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:24.540914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:24.669520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:24.678168 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1fd422f4-8c0c-4e4b-8b72-1770c0dea480 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1723 microversion: 2.1 time: 0.152115 Aug 30 12:11:24.678725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 214/411] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:24 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:25.699600 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:25.700243 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:25.711161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:25.711621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:25.716390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:25.716390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:25.716390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:25.716390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:25.846347 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:25.854572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cde4d7d1-a86d-4c7f-b728-72bd47db5f25 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1700 microversion: 2.1 time: 0.158908 Aug 30 12:11:25.860192 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 198/412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:25 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:25.876234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-766516d1-c010-4112-be2b-15543d96f4ee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:25.882652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-766516d1-c010-4112-be2b-15543d96f4ee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:25.883132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-766516d1-c010-4112-be2b-15543d96f4ee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:25.883628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-766516d1-c010-4112-be2b-15543d96f4ee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:25.952546 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-766516d1-c010-4112-be2b-15543d96f4ee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Going to try to start instance {{(pid=121191) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 12:11:26.132620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-766516d1-c010-4112-be2b-15543d96f4ee tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action" status: 202 len: 0 microversion: 2.1 time: 0.260613 Aug 30 12:11:26.133219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 215/413] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:11:25 2022] POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:11:26.141706 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:26.142306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:26.149364 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:26.149936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:26.150367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:26.151046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:26.151521 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:26.151932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:26.281595 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:26.289861 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cf524bc5-1871-44a4-8c05-dd32fad130f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1709 microversion: 2.1 time: 0.152157 Aug 30 12:11:26.290429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 199/414] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:26 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:27.312512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:27.313214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:27.320016 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:27.320499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:27.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:27.321622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:27.322076 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:27.322504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:27.456446 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:27.464759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-20482b23-b2a8-4f09-b66e-ffec98948940 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1709 microversion: 2.1 time: 0.157588 Aug 30 12:11:27.465326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 216/415] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:27 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:28.485788 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:28.486324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:28.492690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:28.493165 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:28.493608 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:28.494273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:28.494717 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:28.495124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:28.625554 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:28.633575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ec70a2dc-8af8-405b-8761-a5d742979af1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1709 microversion: 2.1 time: 0.151942 Aug 30 12:11:28.634127 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 200/416] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:28 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:29.655765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:29.656315 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:29.662946 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:29.663418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:29.663843 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:29.664543 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:29.664993 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:29.665409 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:29.792890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:29.801491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d9179a7b-dabb-4a42-a148-842792156ffd tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1709 microversion: 2.1 time: 0.150246 Aug 30 12:11:29.802055 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 217/417] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:29 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:30.822552 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:30.823144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:30.830249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:30.830726 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:30.831152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:30.831827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:30.832315 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:30.832730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:30.963771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:30.972784 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-51058559-d6c2-4ae7-90a9-7e79e4eb5af3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1709 microversion: 2.1 time: 0.154103 Aug 30 12:11:30.973330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 201/418] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:30 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:31.994267 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:31.995149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:32.001763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:32.002231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:32.002657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:32.003334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:32.003779 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:32.004217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:32.137622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:32.145955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-60c8e0bb-3b1f-4ca3-a518-4c75eca5c224 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1713 microversion: 2.1 time: 0.155540 Aug 30 12:11:32.146522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 218/419] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:31 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:33.545019 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:33.545531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:33.551849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:33.552359 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:33.552810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:33.553480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:33.553925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:33.554335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:33.679521 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lazy-loading 'services' on Instance uuid 7a615cb0-f264-420f-b63a-232ae546db71 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:11:33.932653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ef182a7b-fcc8-4686-aa6f-1f46c92a0157 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71/os-volume_attachments/e27ab6fe-53ed-4d0d-bfbd-469ba0da0f97" status: 202 len: 0 microversion: 2.1 time: 0.391412 Aug 30 12:11:33.933241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 202/420] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:11:33 2022] DELETE /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71/os-volume_attachments/e27ab6fe-53ed-4d0d-bfbd-469ba0da0f97 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:11:36.118011 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:36.118577 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:36.121312 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=46 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:36.126802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:36.129682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:36.129682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:36.129682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:36.129682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:36.130061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:36.154736 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:11:36.494118 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3e4acdc6-1aad-42dd-b5a8-745beee6ba11 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 204 len: 0 microversion: 2.1 time: 0.379498 Aug 30 12:11:36.494642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 219/421] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:11:36 2022] DELETE /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:11:36.504516 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:36.506804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:36.507196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=44 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:36.512122 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:36.512601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:36.513070 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:36.514024 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:36.514478 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:36.514902 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:36.817585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:36.825217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bcfebf35-c5ff-4aa3-8cc6-a665810fd235 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1513 microversion: 2.1 time: 0.325426 Aug 30 12:11:36.826430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 203/422] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:36 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:37.848184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:37.848791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:37.855120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:37.855594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:37.856052 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:37.856733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:37.857177 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:37.857776 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:37.987916 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:37.995578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dad0cc3a-f527-4218-b000-67f8f5a9ae6c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1513 microversion: 2.1 time: 0.151875 Aug 30 12:11:37.996159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 220/423] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:37 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:39.017824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:39.018424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:39.025009 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:39.025482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:39.025902 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:39.026582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:39.027024 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:39.027437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:39.159809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:39.167553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e168019c-e630-43d6-a2b6-14a11a372ee6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1513 microversion: 2.1 time: 0.154227 Aug 30 12:11:39.168142 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 204/424] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:39 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:39.468576 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-9556a1f4-08d2-440b-8218-8cb55005ff11 req-f4f707e8-5e02-470b-9a9a-415a865e5323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a615cb0-f264-420f-b63a-232ae546db71", "name": "network-vif-deleted", "tag": "714eaeee-484b-4696-85eb-8974172eab61"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:39.478365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-9556a1f4-08d2-440b-8218-8cb55005ff11 req-f4f707e8-5e02-470b-9a9a-415a865e5323 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:39.482955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-9556a1f4-08d2-440b-8218-8cb55005ff11 req-f4f707e8-5e02-470b-9a9a-415a865e5323 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:39.482955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-9556a1f4-08d2-440b-8218-8cb55005ff11 req-f4f707e8-5e02-470b-9a9a-415a865e5323 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:39.492761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-9556a1f4-08d2-440b-8218-8cb55005ff11 req-f4f707e8-5e02-470b-9a9a-415a865e5323 service nova] Creating event network-vif-deleted:714eaeee-484b-4696-85eb-8974172eab61 for instance 7a615cb0-f264-420f-b63a-232ae546db71 on hv-cinder-83976 Aug 30 12:11:39.497346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-9556a1f4-08d2-440b-8218-8cb55005ff11 req-f4f707e8-5e02-470b-9a9a-415a865e5323 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033024 Aug 30 12:11:39.498818 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 221/425] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:11:40.188480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:40.189023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:40.195272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:40.195746 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:40.196214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:40.196897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:40.197344 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:40.197760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:40.231807 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:40.232394 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:40.232823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:40.233271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lazy-loading 'fault' on Instance uuid 7a615cb0-f264-420f-b63a-232ae546db71 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:11:40.276813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:40.285077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f172703f-3740-4660-bd1f-0c285c03012d tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 200 len: 1309 microversion: 2.1 time: 0.101112 Aug 30 12:11:40.285643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 205/426] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:40 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:41.307182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:41.307869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 7a615cb0-f264-420f-b63a-232ae546db71] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:41.315081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:41.315497 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:41.315924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:41.316615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:41.317059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:41.317472 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:41.321576 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:41.331956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] HTTP exception thrown: Instance 7a615cb0-f264-420f-b63a-232ae546db71 could not be found. Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Request method failure captured: Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 HTTP/1.1 Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf4d5o1jvyydGNRgqyby42T2J0QuFxck244A3mOaYM2or5YSckgAUAbx3nryfsZl_ZvjKaW2EzhdYEJHE-Wn3-_nEN4JEyS8ZHQR_NG9ywTQyZqF29Kkd8fWa5b6q_p_JOJAFOV4i9pd3MXFEeSOZU75udv6wJjYtga29PHan4qO0EY Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 24cf8197b5444f6e98b6663a5a08c6dc Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1534570253 Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:11:41.333523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-VolumesSnapshotTestJSON-1534570253 Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 24cf8197b5444f6e98b6663a5a08c6dc Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1534570253 Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-VolumesSnapshotTestJSON-1534570253-project Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5312919483f944b29317aa22db224503 Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-VolumesSnapshotTestJSON-1534570253-project Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 7a615cb0-f264-420f-b63a-232ae546db71 could not be found. Aug 30 12:11:41.335117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '7a615cb0-f264-420f-b63a-232ae546db71'} Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a615cb0-f264-420f-b63a-232ae546db71 could not be found. Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:11:41.336069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a615cb0-f264-420f-b63a-232ae546db71 could not be found. Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a615cb0-f264-420f-b63a-232ae546db71 could not be found. Aug 30 12:11:41.337594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:11:41.338947 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Returning 404 to user: Instance 7a615cb0-f264-420f-b63a-232ae546db71 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:11:41.338947 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8e6c2880-b152-467a-87da-8ffae5dd7dac tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71" status: 404 len: 111 microversion: 2.1 time: 0.032707 Aug 30 12:11:41.338947 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 222/427] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:41 2022] GET /compute/v2.1/servers/7a615cb0-f264-420f-b63a-232ae546db71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:11:46.674686 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "accbe19b-7e48-4be6-a248-585861184019"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:46.677111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:46.683729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:46.684244 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:46.684678 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:46.685424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:46.685873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:46.686294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:47.470234 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-551fc632-4a9c-469d-907a-588900e73b6b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800107 Aug 30 12:11:47.470850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 206/428] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:11:46 2022] POST /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:11:51.736638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-231228130", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "networks": [{"uuid": "7c842611-2f64-466c-bd69-f602304d47ee"}]}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:51.745911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:51.795747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] validate_networks() for [('7c842611-2f64-466c-bd69-f602304d47ee', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:11:52.149597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:11:52.150121 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:11:52.150597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:11:52.151211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:11:52.151702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:11:52.161339 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:52.161751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:52.162181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:52.162899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:52.163348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:52.163769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:52.180097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Getting quotas for project 24cf8197b5444f6e98b6663a5a08c6dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:11:52.183998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Getting quotas for user 5312919483f944b29317aa22db224503 and project 24cf8197b5444f6e98b6663a5a08c6dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:11:52.194930 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:11:52.197252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:11:52.330938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6def024d-2dee-4118-9566-6a64e2b5dd54 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598707 Aug 30 12:11:52.331604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 223/429] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:11:52.344770 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9cd80782-c555-45fb-9565-b6c0d55c2283 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:52.345482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9cd80782-c555-45fb-9565-b6c0d55c2283 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:52.401360 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9cd80782-c555-45fb-9565-b6c0d55c2283 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:52.409518 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9cd80782-c555-45fb-9565-b6c0d55c2283 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1218 microversion: 2.1 time: 0.070571 Aug 30 12:11:52.410071 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 207/430] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:52 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:53.430597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:53.431204 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:53.437329 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:53.438012 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:53.438436 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:53.439125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:53.439572 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:53.440029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:53.503762 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:53.511569 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-de35b867-186a-4146-aa65-9d93588fb1e7 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1214 microversion: 2.1 time: 0.085701 Aug 30 12:11:53.512155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 224/431] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:53 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:54.537211 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:54.537820 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:54.544467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:54.545620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:54.545620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:54.546031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:54.546480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:54.546979 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:54.551198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:11:54.611052 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:54.618873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-411abde5-1b3f-45a8-903d-7edefe0fa4a9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1278 microversion: 2.1 time: 0.085499 Aug 30 12:11:54.619663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 208/432] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:54 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:55.640331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:55.640910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:55.647216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:55.647698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:55.648167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:55.648862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:55.649315 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:55.649734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:55.809273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:55.817647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1b29e024-6c90-4699-b89a-e0b99598fdc0 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.181372 Aug 30 12:11:55.818217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 225/433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:55 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:56.100675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-6630b3bb-995c-41d5-813f-119a309a60d8 req-43c4567f-92cf-4909-adf7-5bce783959e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6a4b28-9803-420b-b5a2-febb13ca8b72", "tag": "85c4b25c-8e31-4cb3-ab29-ec5529256ac3"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:56.112297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6630b3bb-995c-41d5-813f-119a309a60d8 req-43c4567f-92cf-4909-adf7-5bce783959e5 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:56.112780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6630b3bb-995c-41d5-813f-119a309a60d8 req-43c4567f-92cf-4909-adf7-5bce783959e5 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:56.113207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6630b3bb-995c-41d5-813f-119a309a60d8 req-43c4567f-92cf-4909-adf7-5bce783959e5 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:56.124247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-6630b3bb-995c-41d5-813f-119a309a60d8 req-43c4567f-92cf-4909-adf7-5bce783959e5 service nova] Creating event network-changed:85c4b25c-8e31-4cb3-ab29-ec5529256ac3 for instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 on hv-cinder-83976 Aug 30 12:11:56.130171 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-6630b3bb-995c-41d5-813f-119a309a60d8 req-43c4567f-92cf-4909-adf7-5bce783959e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034671 Aug 30 12:11:56.130819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 209/434] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:11:56.839033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:56.839637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:56.846703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:56.847180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:56.847605 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:56.848303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:56.848751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:56.849169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:56.976499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:56.985468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a0bf2c5a-4d12-48df-ac8b-39bc1ebada13 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.149521 Aug 30 12:11:56.986037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 226/435] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:56 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:58.006701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:58.007391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:58.014561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:58.015039 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:58.015470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:58.016808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:58.017260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:58.017679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:58.149960 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:58.158389 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fd1b0f74-051c-432b-8a5a-e2a259907526 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.155905 Aug 30 12:11:58.158961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 210/436] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:58 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:58.199615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:11:58.201949 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:58.208710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:58.209193 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:58.209629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:58.210309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:58.210762 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:58.211183 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:58.233794 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lazy-loading 'flavor' on Instance uuid 38fea936-d2d6-4953-9ff2-34c126638e3a {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:11:58.447406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3e4390a6-2cdd-4ac1-bd6a-76c4662e8a9e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/action" status: 200 len: 32 microversion: 2.1 time: 0.251591 Aug 30 12:11:58.448007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 227/437] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:11:58 2022] POST /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:11:58.457691 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:58.459324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:58.464393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:58.464881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:58.465451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:58.466141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:58.466596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:58.467023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:58.598831 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:58.606945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-14b4ba9b-e7ac-4a68-91e2-47f772f8cb31 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.153192 Aug 30 12:11:58.607506 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 211/438] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:58 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:59.179333 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:59.180048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:59.186296 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:59.186778 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:59.187207 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:59.187986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:59.188449 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:59.188915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:59.393352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:59.401204 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1c752787-0a62-4ab1-ae73-1a156d1486fc tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.226233 Aug 30 12:11:59.401779 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 228/439] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:59 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:11:59.628869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:11:59.629470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:11:59.635793 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:59.636313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:59.636749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:59.637437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:11:59.637886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:11:59.638312 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:11:59.773396 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:11:59.778866 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7e4cb6e6-3768-4c09-b7bf-4c7d5c34641a tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.153960 Aug 30 12:11:59.779414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 212/440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:11:59 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:00.423129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:00.423648 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:00.430025 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:00.430532 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:00.430968 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:00.431649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:00.432127 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:00.432550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:00.559430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:00.567204 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a5bf34df-c0cf-44ab-b2e4-60a76763fc9c tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.148441 Aug 30 12:12:00.567769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 229/441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:00 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:00.800533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:00.801138 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:00.807524 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:00.808047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:00.808495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:00.809206 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:00.809657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:00.810073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:00.940118 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:00.948135 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-998bb8b6-c71b-4bb3-b964-eac95f3505fc tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.151666 Aug 30 12:12:00.948721 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 213/442] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:00 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:01.588560 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:01.589208 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:01.596323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:01.601384 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:01.601384 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:01.601384 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:01.601384 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:01.601751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:01.808437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:01.820570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-96a57b2a-cc76-4bc0-a16b-82c1084179e6 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.236135 Aug 30 12:12:01.821158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 230/443] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:01 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:01.970499 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:01.971341 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:01.978015 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:01.978805 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:01.979240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:01.980001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:01.980453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:01.980964 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:02.121005 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:02.130879 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7348e047-5c28-448d-9d46-1de465a58c58 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.164593 Aug 30 12:12:02.134175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 214/444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:01 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:02.842033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:02.842638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:02.844987 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:02.845646 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:02.850833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:02.851314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:02.856712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:02.856712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:02.856712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:02.856712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:02.984316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:02.992894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cf3c11e7-2b4d-4a43-b1a3-f6a8e79800de tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.154669 Aug 30 12:12:02.993467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 231/445] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:02 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:03.152515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:03.153070 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:03.154908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:03.160940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.161411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.161836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.162509 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.162956 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.163371 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.295641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:03.305485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5648c18b-a7e7-4920-a606-013d3b137e4c tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.156853 Aug 30 12:12:03.306042 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 215/446] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:03 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:03.392030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:03.392528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:03.398423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.398902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.399337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.400115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.400632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.400994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.434031 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-54fd0421-57ba-4822-b7bc-f0f05dccc160 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments/88486be8-9ef2-4af1-9d2a-29e05dad03bd" status: 200 len: 194 microversion: 2.20 time: 0.046386 Aug 30 12:12:03.434557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 232/447] 10.222.0.42 () {60 vars in 1454 bytes} [Tue Aug 30 12:12:03 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments/88486be8-9ef2-4af1-9d2a-29e05dad03bd => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:12:03.500008 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:03.501175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:03.507049 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.507525 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.508001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.508675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.509115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.509526 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.588622 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lazy-loading 'services' on Instance uuid 294a2d1c-a5ff-4f5e-945f-03a42a7800cc {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:12:03.820746 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9a180650-557a-4e19-86e5-1529ab337d7f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments/88486be8-9ef2-4af1-9d2a-29e05dad03bd" status: 202 len: 0 microversion: 2.20 time: 0.324318 Aug 30 12:12:03.821436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 216/448] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Aug 30 12:12:03 2022] DELETE /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments/88486be8-9ef2-4af1-9d2a-29e05dad03bd => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:12:03.829799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:03.832039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:03.837885 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.838367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.838792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.839474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:03.839920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:03.840365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:03.871106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b4fd834c-bebb-42b6-a9e7-b512b0bffcfe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045273 Aug 30 12:12:03.871743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 233/449] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Aug 30 12:12:03 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:12:04.015014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:04.016351 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:04.022919 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:04.023427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:04.023964 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:04.024666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:04.025127 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:04.025550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:04.111083 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-b102b6ea-b4a4-493f-afc0-89e06eee84a4 req-f549e0f0-e8ac-47dd-b218-aedb9074ed1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6a4b28-9803-420b-b5a2-febb13ca8b72", "name": "network-vif-plugged", "status": "completed", "tag": "85c4b25c-8e31-4cb3-ab29-ec5529256ac3"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:04.128890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-b102b6ea-b4a4-493f-afc0-89e06eee84a4 req-f549e0f0-e8ac-47dd-b218-aedb9074ed1b service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:04.129375 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-b102b6ea-b4a4-493f-afc0-89e06eee84a4 req-f549e0f0-e8ac-47dd-b218-aedb9074ed1b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:04.129804 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-b102b6ea-b4a4-493f-afc0-89e06eee84a4 req-f549e0f0-e8ac-47dd-b218-aedb9074ed1b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:04.141290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-b102b6ea-b4a4-493f-afc0-89e06eee84a4 req-f549e0f0-e8ac-47dd-b218-aedb9074ed1b service nova] Creating event network-vif-plugged:85c4b25c-8e31-4cb3-ab29-ec5529256ac3 for instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 on hv-cinder-83976 Aug 30 12:12:04.146395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-b102b6ea-b4a4-493f-afc0-89e06eee84a4 req-f549e0f0-e8ac-47dd-b218-aedb9074ed1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040649 Aug 30 12:12:04.147014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 234/450] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:12:04.165432 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:04.173680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ce265c31-698a-4576-b7e8-27fbd9c820e5 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.163830 Aug 30 12:12:04.174233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 217/451] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:04 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:04.327303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:04.328036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:04.334689 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:04.335169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:04.335605 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:04.336327 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:04.336786 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:04.337214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:04.477449 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:04.485764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-63af5b58-49af-45be-afac-187041a514c0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.162784 Aug 30 12:12:04.486335 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 235/452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:04 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:04.883612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:04.885929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:04.891993 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:04.892479 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:04.892910 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:04.893596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:04.894045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:04.894463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:04.928381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3a063d85-5241-4f0d-b3ff-69c9ed8dc8d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048611 Aug 30 12:12:04.928862 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 218/453] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Aug 30 12:12:04 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:12:05.194968 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:05.195492 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:05.201822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:05.202330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:05.202766 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:05.203492 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:05.204195 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:05.204624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:05.337693 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:05.346403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-17f6a12c-1605-42dc-86e8-17db3020c1ae tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.155360 Aug 30 12:12:05.346999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 236/454] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:05 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:05.506958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:05.507610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:05.513905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:05.514380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:05.514808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:05.515478 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:05.515925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:05.516468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:05.646247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:05.654302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-85cee0f8-d8e7-4d2c-89cb-678b879c31f0 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.151191 Aug 30 12:12:05.654865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 219/455] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:05 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:05.941336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:05.943653 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:05.949594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:05.950081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:05.950513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:05.951200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:05.951654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:05.952120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:05.989863 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5bc98a17-2c43-4942-b005-5809618c4c48 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053177 Aug 30 12:12:05.990435 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 237/456] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Aug 30 12:12:05 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:06.053092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:06.053612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:06.059496 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.060031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.060570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.061255 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.061704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.062122 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.087740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:12:06.345047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8ec9ec40-ed89-450b-bb1a-d179c468e32a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 204 len: 0 microversion: 2.20 time: 0.295178 Aug 30 12:12:06.345553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 220/457] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Aug 30 12:12:06 2022] DELETE /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 12:12:06.354306 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:06.354919 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:06.361318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.361979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.362419 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.363109 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.363563 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.364009 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.368918 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:06.369604 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:06.375487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.375934 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.376386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.377166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.377616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.378054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.513426 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:06.517316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:06.524146 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:06.525702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:06.527167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-310cddbd-a8b0-4cca-ae13-c81e9f3040cb tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.176463 Aug 30 12:12:06.527724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 238/458] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:06 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:06.540446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:06.546114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fff1bee8-6fc1-4b44-8f98-7ec223c9bb4b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1318 microversion: 2.1 time: 0.181314 Aug 30 12:12:06.547748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 221/459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:06 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:06.677781 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:06.678322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:06.684566 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.685045 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.685477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.686154 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:06.686603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:06.687022 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:06.817823 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:06.825887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-79965b44-5687-4dc6-a41c-4ae2e19bb235 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.152474 Aug 30 12:12:06.826437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 239/460] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:06 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:07.550942 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:07.551547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:07.553940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:07.558570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.559124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.565274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.565274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.565274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.565274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.568610 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:07.569226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:07.575674 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.576199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.576639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.577404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.577861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.578285 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.696562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:07.704641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:07.706974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:07.708151 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4d3ede4e-be76-4e02-88b2-99d8382586a3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.161337 Aug 30 12:12:07.708713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 222/461] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:07 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:07.715651 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:07.724414 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-13eb6da4-5f83-4f53-ae30-578462603dc2 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1507 microversion: 2.1 time: 0.160280 Aug 30 12:12:07.724971 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 240/462] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:07 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:07.746055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82a5ada9-f875-4882-aac1-9141178cddcb", "device": "/dev/sdb"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:07.748529 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:07.755509 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.756007 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.756441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.757121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.757566 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.757986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.760310 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:07.847198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:07.847839 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:07.853867 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.854352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.854784 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.855532 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:07.856013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:07.856440 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:07.985251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:07.993957 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-12d98e4f-0ee5-45c1-a4c5-851769eaeadd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.151218 Aug 30 12:12:07.994527 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 241/463] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:07 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:08.730926 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:08.731537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:08.739560 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:08.742425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:08.742425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:08.742425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:08.742425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:08.742835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:09.000225 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:09.005797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:09.007341 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:09.008614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ccf76cb9-1d93-4beb-a92e-de2572ccce32 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1724 microversion: 2.20 time: 0.281688 Aug 30 12:12:09.009362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 242/464] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:08 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:09.014909 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:09.015512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:09.026929 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:09.031008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:09.031008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:09.031008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:09.031008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:09.031397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:09.032096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2e1e2d16-b064-4d92-9070-c3450af0297b tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "POST /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.289373 Aug 30 12:12:09.033141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 223/465] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:12:07 2022] POST /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72/os-volume_attachments => generated 194 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:09.209322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:09.217450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7b081f39-1e69-4ba1-a378-2d0bc540e3c3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.206289 Aug 30 12:12:09.218829 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 243/466] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:09 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:09.567449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-2e6b2e26-0b18-4637-9579-4250073e124d req-d9ba9056-7d81-4943-957f-41b90e9436f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294a2d1c-a5ff-4f5e-945f-03a42a7800cc", "name": "network-vif-deleted", "tag": "1a156fe5-05f5-48b0-bb53-3f8c98e5846a"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:09.580139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2e6b2e26-0b18-4637-9579-4250073e124d req-d9ba9056-7d81-4943-957f-41b90e9436f1 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:09.581525 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2e6b2e26-0b18-4637-9579-4250073e124d req-d9ba9056-7d81-4943-957f-41b90e9436f1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:09.582279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-2e6b2e26-0b18-4637-9579-4250073e124d req-d9ba9056-7d81-4943-957f-41b90e9436f1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:09.593771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-2e6b2e26-0b18-4637-9579-4250073e124d req-d9ba9056-7d81-4943-957f-41b90e9436f1 service nova] Creating event network-vif-deleted:1a156fe5-05f5-48b0-bb53-3f8c98e5846a for instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc on hv-cinder-83976 Aug 30 12:12:09.600212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-2e6b2e26-0b18-4637-9579-4250073e124d req-d9ba9056-7d81-4943-957f-41b90e9436f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036701 Aug 30 12:12:09.601050 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 224/467] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:10.031998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:10.032617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:10.039493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:10.042116 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:10.042116 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:10.042116 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:10.042116 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:10.042491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:10.085669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:10.086156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:10.086586 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:10.087032 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lazy-loading 'fault' on Instance uuid 294a2d1c-a5ff-4f5e-945f-03a42a7800cc {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:12:10.165321 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:10.194738 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:10.196947 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:10.198756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dfe29899-06db-4819-98b7-ed145bd9678e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 200 len: 1372 microversion: 2.20 time: 0.171589 Aug 30 12:12:10.199513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 244/468] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:10 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:10.241349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:10.242185 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:10.249325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:10.249968 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:10.250503 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:10.251324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:10.251890 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:10.252592 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:10.407891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:10.416843 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a9eb154b-8061-4ca6-ae11-0231a7656219 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.181086 Aug 30 12:12:10.417417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 225/469] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:10 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:11.224847 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:11.225683 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:11.231889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:11.232498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:11.233030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:11.233900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:11.234448 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:11.235054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:11.251984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] HTTP exception thrown: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Request method failure captured: Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc HTTP/1.1 Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2gc_rszzmO68_hMQTvH2UzM-_k9JkTSFQeh86UoNVDlwaYVzE54UJl6rMvUKeRePF74fpTI2D9YOlAXJwdCffLLW9HVqV7KTgKPCRnyAgLF2q7ssvxjS9QG_wY7RTUNSdKRZqt_DCdjxGPSNG1TndwfCNqqgBpX2V0aktAYf9JFrE Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:12:11.254248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 1c1d151da5cb4b27a2bf9b71e82d70dc Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:12:11.255904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '294a2d1c-a5ff-4f5e-945f-03a42a7800cc'} Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:12:11.256960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:12:11.258421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:11.261013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Returning 404 to user: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:12:11.261869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e31b0e27-db6e-4c38-9c0c-8714c1aaa628 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 404 len: 111 microversion: 2.20 time: 0.042996 Aug 30 12:12:11.262718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 245/470] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:11 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:12:11.272142 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a7fa4db2-49ae-4926-b876-800ebe4dc192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '.version_select at 0x7efe4ef5a790>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:11.374912 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a7fa4db2-49ae-4926-b876-800ebe4dc192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154688898" status: 204 len: 0 microversion: 2.20 time: 0.107619 Aug 30 12:12:11.375496 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 226/471] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Aug 30 12:12:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154688898 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 12:12:11.438831 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:11.439550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:11.445792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:11.446274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:11.446709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:11.447473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:11.447927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:11.448373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:11.594595 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:11.604504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-447e0bf8-a5bc-4396-bc75-23a1e40cc6b1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.169575 Aug 30 12:12:11.605073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 246/472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:11 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:12.239651 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c9d02784-4043-4f51-8ce5-88ae76dfab19 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'create', calling method: .version_select at 0x7efe4eee7310>, body: {"keypair": {"name": "tempest-keypair-151487128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK4TUpzrGeLwwhvip1GCgDKx4nlW3jhEGl93/t3x1NtiRsl69UwY5vh1KmJQiJy8DVAv7r1FG5R6r7l2n+blFKsUFY6+HeZxT8tZosVCLrsNEeUkIweBnZfZkE+3KxVUQ=="}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:12.256491 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-c9d02784-4043-4f51-8ce5-88ae76dfab19 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:12:12.260481 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-c9d02784-4043-4f51-8ce5-88ae76dfab19 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for user 1c1d151da5cb4b27a2bf9b71e82d70dc and project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:12:12.347748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c9d02784-4043-4f51-8ce5-88ae76dfab19 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.113130 Aug 30 12:12:12.348539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 227/473] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Aug 30 12:12:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 12:12:12.631100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:12.631735 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:12.638237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:12.646227 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:12.646227 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:12.646227 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:12.646227 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:12.646595 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:12.771224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:12.779550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5a4d98ff-8979-46b5-8228-3c3b53f6f612 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.153050 Aug 30 12:12:12.780149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 247/474] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:12 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:13.801741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:13.802769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:13.809152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:13.809635 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:13.810069 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:13.810756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:13.811213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:13.811634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:13.835223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:13.835723 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:13.850765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:13.851309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:13.854253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:13.854253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:13.854253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:13.854253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:13.977739 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:13.983145 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lazy-loading 'services' on Instance uuid 17fac3ff-6458-4118-994c-d9eebd1b8a30 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:12:13.985940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9e557af2-bfd5-4098-b8b9-9225d8d184da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.188900 Aug 30 12:12:13.986684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 228/475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:13 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:14.226829 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-01d54195-6232-4cb1-ba23-ce864be9623f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-volume_attachments/62fb27f4-0fc5-41a1-bc71-5e508b38cc0a" status: 202 len: 0 microversion: 2.1 time: 0.398170 Aug 30 12:12:14.227540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 248/476] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:12:13 2022] DELETE /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-volume_attachments/62fb27f4-0fc5-41a1-bc71-5e508b38cc0a => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:12:14.466482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-816204123", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d40ebbd7-73a7-4467-b2ec-337128c5f770"}], "security_groups": [{"name": "tempest-securitygroup--1678073302"}], "key_name": "tempest-keypair-151487128", "user_data": "}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:14.571610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] validate_networks() for [('d40ebbd7-73a7-4467-b2ec-337128c5f770', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:12:14.933339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:12:14.933945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:12:14.934232 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:12:14.934643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:12:14.935056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:12:14.944383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:14.944865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:14.945298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:14.946021 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:14.946477 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:14.946901 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:14.964259 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:12:14.968205 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Getting quotas for user 1c1d151da5cb4b27a2bf9b71e82d70dc and project 218bec3fcc71460eb8b7f89ecf66b816. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:12:14.980074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:12:14.982350 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:12:15.007614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:15.008368 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:15.015023 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:15.015512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:15.015967 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:15.016664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:15.017122 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:15.017552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:15.093497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-74fbfa38-1502-4c25-9e32-95ba89982374 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631229 Aug 30 12:12:15.094806 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 229/477] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Aug 30 12:12:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 12:12:15.106352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-386b1ca6-bab3-4d92-8c09-1b9e9d1a56ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:15.107440 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-386b1ca6-bab3-4d92-8c09-1b9e9d1a56ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:15.164752 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:15.166572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-386b1ca6-bab3-4d92-8c09-1b9e9d1a56ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:15.173527 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-aee55c55-c656-4ba2-bb53-2d40d49df5da tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.170525 Aug 30 12:12:15.174374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-386b1ca6-bab3-4d92-8c09-1b9e9d1a56ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:15.175808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-386b1ca6-bab3-4d92-8c09-1b9e9d1a56ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:15.177181 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-386b1ca6-bab3-4d92-8c09-1b9e9d1a56ad tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1280 microversion: 2.20 time: 0.075337 Aug 30 12:12:15.177726 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 230/478] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:15 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:12:15.188044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 249/479] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:15 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:16.195435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:16.196555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:16.198591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:16.199220 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:16.203445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:16.207263 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:16.207263 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:16.207263 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:16.208003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:16.208137 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:16.208267 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:16.208418 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:16.208516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:16.208516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:16.208516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:16.208844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:16.285634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:16.294098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:16.295547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:16.296670 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8706db35-b439-4b59-a0b2-11a76852b452 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1284 microversion: 2.20 time: 0.101967 Aug 30 12:12:16.298883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 250/480] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:16 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:12:16.345472 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:16.354848 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dfee525b-0092-4761-ba01-669c33007adf tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.164062 Aug 30 12:12:16.355429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 231/481] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:16 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:17.324331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:17.326258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:17.332881 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:17.333423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:17.333974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:17.334676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:17.335204 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:17.335541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:17.376174 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:17.377127 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:17.383377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:17.383845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:17.384308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:17.384995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:17.385443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:17.385858 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:17.400507 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:17.413003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:17.414741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:17.415873 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9431a4c0-672c-4930-bbcc-0c6e913157e9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1332 microversion: 2.20 time: 0.095453 Aug 30 12:12:17.418830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 251/482] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:17 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:17.523845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:17.531935 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-af1cf2e1-95f9-48e6-b1e8-1280360a6aeb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.159561 Aug 30 12:12:17.532523 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 232/483] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:17 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:18.446652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:18.447251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:18.453633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:18.454108 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:18.454539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:18.455216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:18.455665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:18.456121 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:18.517498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:18.526411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:18.527840 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:18.528948 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9d0bc1aa-3320-4d2a-bdd0-ab1ea9d2831c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1332 microversion: 2.20 time: 0.086189 Aug 30 12:12:18.529514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 252/484] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:18 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:18.553336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:18.553946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:18.560375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:18.560857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:18.561291 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:18.561970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:18.562423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:18.562842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:18.694148 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:18.702223 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dea086c6-8704-4e5f-b8c4-c6292820a4b8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.152749 Aug 30 12:12:18.702790 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 233/485] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:18 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:19.550522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:19.551127 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:19.558018 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:19.558501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:19.558933 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:19.559655 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:19.560141 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:19.560567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:19.622540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:19.631616 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:19.633113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:19.634211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-20ede64d-01f0-48c3-814e-ebc1371ffc4b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1332 microversion: 2.20 time: 0.087508 Aug 30 12:12:19.634767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 253/486] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:19 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:19.726920 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:19.727563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:19.734249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:19.734728 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:19.735154 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:19.736175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:19.736647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:19.737065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:19.868076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:19.876291 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2604522a-1ab8-4bba-9a69-c268fef20795 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.155519 Aug 30 12:12:19.876857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 234/487] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:19 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:20.657311 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:20.657920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:20.664946 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:20.665428 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:20.665869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:20.666615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:20.667087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:20.667489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:20.740176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:20.749130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:20.750574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:20.751693 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ccefee48-3bab-4ab1-9f49-30f82b4c55dc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1332 microversion: 2.20 time: 0.098356 Aug 30 12:12:20.752281 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 254/488] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:20 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:20.898104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:20.898714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:20.905105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:20.905589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:20.906025 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:20.906704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:20.907159 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:20.907585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:21.032993 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:21.042078 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-def54376-e6e6-4638-9e06-16fc9a8976d7 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.147976 Aug 30 12:12:21.042640 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 235/489] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:20 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:21.708624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0ec885e6-b6b0-4c01-bab7-e38b129f4267 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:21.715425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0ec885e6-b6b0-4c01-bab7-e38b129f4267 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:21.715937 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0ec885e6-b6b0-4c01-bab7-e38b129f4267 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:21.716395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0ec885e6-b6b0-4c01-bab7-e38b129f4267 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:21.720049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:21.740044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0ec885e6-b6b0-4c01-bab7-e38b129f4267 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Going to try to stop instance {{(pid=121191) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 12:12:21.775560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:21.776214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:21.782336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:21.782921 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:21.783358 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:21.784407 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:21.785152 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:21.786246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:21.852603 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:21.860587 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:21.862023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:21.863109 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6e413049-197f-4146-b6fc-344974642e97 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1340 microversion: 2.20 time: 0.091573 Aug 30 12:12:21.863668 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 236/490] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:21 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:12:21.961398 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0ec885e6-b6b0-4c01-bab7-e38b129f4267 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action" status: 202 len: 0 microversion: 2.1 time: 0.257133 Aug 30 12:12:21.961892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 255/491] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:12:21 2022] POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:12:21.970026 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:21.970913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:21.977570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:21.978056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:21.978492 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:21.979177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:21.979634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:21.980092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:22.068363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:22.069153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:22.071143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:22.076117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:22.076685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:22.077040 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:22.077730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:22.078184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:22.078614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:22.110752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:22.120096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0dc25e50-9462-4c95-8915-935403291014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.153332 Aug 30 12:12:22.120683 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 237/492] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:21 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:22.211607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:22.221103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-624895ee-9755-43b4-ab0c-ef9a513a5052 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.157918 Aug 30 12:12:22.221701 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 256/493] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:22 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:22.889898 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:22.890498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:22.896609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:22.897088 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:22.897519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:22.898191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:22.898642 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:22.899058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:22.961436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:22.969349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:22.971031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:22.972167 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-09bc88f3-5915-4978-9541-fb7b35ca34a2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1350 microversion: 2.20 time: 0.086164 Aug 30 12:12:22.972727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 238/494] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:22 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:23.141668 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:23.142194 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:23.148703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:23.149187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:23.149619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:23.150302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:23.150754 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:23.151176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:23.243029 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:23.243638 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:23.250047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:23.257662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:23.257662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:23.257662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:23.257662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:23.258061 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:23.280556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:23.289045 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ffe2d4cf-b776-43c9-bbb9-143d848d053e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.151295 Aug 30 12:12:23.291883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 257/495] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:23 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:23.382312 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:23.390821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-605ed263-0a4f-4b7c-ac54-e5198ad09238 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.152175 Aug 30 12:12:23.391383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 239/496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:23 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:23.994270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:23.994872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:24.000972 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:24.001453 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:24.001887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:24.002565 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:24.003015 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:24.003465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:24.064004 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:24.072654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:24.074120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:24.075240 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8749da2e-497a-4f85-81b5-bf62650eed76 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1350 microversion: 2.20 time: 0.084980 Aug 30 12:12:24.075807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 258/497] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:23 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:24.310779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:24.311364 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:24.318888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:24.319367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:24.319799 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:24.320701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:24.321235 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:24.321662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:24.412280 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:24.412925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:24.419484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:24.420252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:24.420704 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:24.421389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:24.421893 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:24.422320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:24.465062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:24.475651 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-87b7b749-4949-4119-90ad-949daa01a6b4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.168786 Aug 30 12:12:24.488664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 240/498] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:24 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:24.667033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:24.675385 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9eede351-0b9b-476e-adfe-8d2b58ec90f8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.267049 Aug 30 12:12:24.676168 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 259/499] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:24 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:25.099691 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:25.100524 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:25.104191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:25.111577 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:25.112034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:25.112475 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:25.113191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:25.113804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:25.114196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:25.170609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=12 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:25.246941 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:25.261075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:25.261075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:25.261075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e78f1c21-4cd3-4c73-b1e1-f88f1b6f5cda tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.163801 Aug 30 12:12:25.261446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 241/500] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:25 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:25.498834 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:25.499594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:25.506778 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:25.507265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:25.507709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:25.508440 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:25.508901 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:25.509328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:25.699015 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:25.699632 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:25.705768 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:25.706247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:25.706863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:25.708552 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:25.709884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:25.709884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:25.758689 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:25.773293 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fe29d437-19f8-4bdd-bedd-ea33ced826c3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.278067 Aug 30 12:12:25.786825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 260/501] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:25 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:25.869516 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:25.872730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:25.879085 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-563446aa-592c-455f-9c2f-c48aff36bae1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1734 microversion: 2.1 time: 0.183924 Aug 30 12:12:25.888385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 242/502] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:25 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:26.267398 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-2ce45d39-1e28-45eb-a2c0-69f420430689 req-50a17430-1db2-459d-b1ef-e7184a59fc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a946d9a-667e-4a85-bd51-7ffee16f8905", "tag": "5634a068-6874-4e11-8b3a-39d600ea396c"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:26.277727 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2ce45d39-1e28-45eb-a2c0-69f420430689 req-50a17430-1db2-459d-b1ef-e7184a59fc3c service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:26.278295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2ce45d39-1e28-45eb-a2c0-69f420430689 req-50a17430-1db2-459d-b1ef-e7184a59fc3c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:26.278799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2ce45d39-1e28-45eb-a2c0-69f420430689 req-50a17430-1db2-459d-b1ef-e7184a59fc3c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:26.281915 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:26.282725 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:26.289900 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:26.292215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:26.292215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:26.292215 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:26.292494 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-2ce45d39-1e28-45eb-a2c0-69f420430689 req-50a17430-1db2-459d-b1ef-e7184a59fc3c service nova] Creating event network-changed:5634a068-6874-4e11-8b3a-39d600ea396c for instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 on hv-cinder-83976 Aug 30 12:12:26.292598 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:26.292598 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:26.296710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-2ce45d39-1e28-45eb-a2c0-69f420430689 req-50a17430-1db2-459d-b1ef-e7184a59fc3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033097 Aug 30 12:12:26.297308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 261/503] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:26.426727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:26.434675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:26.436189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:26.437284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-daa0545a-1c4d-4530-a335-d2134529216f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.159494 Aug 30 12:12:26.437849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 243/504] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:26 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:12:26.795486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:26.796327 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:26.803228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:26.803709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:26.804169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:26.804858 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:26.805557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:26.806121 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:26.901835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:26.902438 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:26.909031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:26.909510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:26.909941 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:26.910622 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:26.911851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:26.912321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.030833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:27.039085 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-abd5e924-d69c-4a19-8cc6-cfb74167d334 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.248210 Aug 30 12:12:27.053345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 262/505] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:26 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:27.053573 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:27.058730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a5ee7af7-a71c-4662-a9f2-7a225f090621 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1714 microversion: 2.1 time: 0.161085 Aug 30 12:12:27.059312 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 244/506] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:26 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:27.172231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:27.172833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:27.179778 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.180429 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.180976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.181817 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.182379 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.182900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.266524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] HTTP exception thrown: Cannot 'detach_volume' instance 38fea936-d2d6-4953-9ff2-34c126638e3a while it is in vm_state rescued Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Request method failure captured: Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments/accbe19b-7e48-4be6-a248-585861184019 HTTP/1.1 Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2chFL7TTDwBqSSUV8iHuKCFNI9kKGw22-zu3q6bTt-658jo2vyt5oBlVcxKaJsHKfjJjzYa9xyikpmnUk2gSMTEKNjyQmyznycs6wSfrKqi2r_B-Slk13ypWUgPlEVY35EcNk2EtR1HiHVw50oruSpIXKm9bZWchHF3EIyqM_E5_A Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:12:27.268547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c040647b03574d3a87a335e10d02ef49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 012ead000e8d411eae7034f296455fe7 Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:12:27.271365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Cannot 'detach_volume' instance 38fea936-d2d6-4953-9ff2-34c126638e3a while it is in vm_state rescued Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'server_id': '38fea936-d2d6-4953-9ff2-34c126638e3a', 'id': 'accbe19b-7e48-4be6-a248-585861184019'} Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38fea936-d2d6-4953-9ff2-34c126638e3a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:12:27.272320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 38fea936-d2d6-4953-9ff2-34c126638e3a while it is in vm_state rescued Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 38fea936-d2d6-4953-9ff2-34c126638e3a while it is in vm_state rescued Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:12:27.273567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Returning 409 to user: Cannot 'detach_volume' instance 38fea936-d2d6-4953-9ff2-34c126638e3a while it is in vm_state rescued {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:12:27.274620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a58ff8d7-bfaa-4e4c-b4df-fe39dc3c4844 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments/accbe19b-7e48-4be6-a248-585861184019" status: 409 len: 152 microversion: 2.1 time: 0.102022 Aug 30 12:12:27.274620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 263/507] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:12:27 2022] DELETE /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments/accbe19b-7e48-4be6-a248-585861184019 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 12:12:27.279814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:27.280426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:27.287017 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.291560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.291560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.291560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.291560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.291987 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.460954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:27.461561 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:27.468649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.469140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.469607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.470349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.470829 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.471541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.535903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-69ed3065-562f-429b-b683-30049245e154 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "POST /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/action" status: 202 len: 0 microversion: 2.1 time: 0.260106 Aug 30 12:12:27.536486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 245/508] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:12:27 2022] POST /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:12:27.548185 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:27.549058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:27.558995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.559420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.559855 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.560582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:27.561041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:27.561461 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:27.608469 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:27.618106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:27.619638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:27.620847 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ec48997e-94c9-4759-9aeb-0e5261903c14 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.163933 Aug 30 12:12:27.621519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 264/509] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:27 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:12:27.693479 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:27.701588 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d7e430d1-f4b3-4a4d-99ab-8e928a016b25 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1722 microversion: 2.1 time: 0.160548 Aug 30 12:12:27.702146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 246/510] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:27 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:28.060656 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:28.063795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:28.067859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:28.068379 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:28.068845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:28.069549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:28.070006 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:28.070432 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:28.200164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:28.207848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0874049b-44d2-40ef-a01d-85a12a9166a7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.151033 Aug 30 12:12:28.208442 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 265/511] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:28 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:28.643876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:28.644530 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:28.651399 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:28.652265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:28.652707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:28.653402 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:28.653885 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:28.654434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:28.723057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:28.724405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:28.730670 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:28.731292 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:28.731836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:28.732670 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:28.733235 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:28.733766 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:28.791309 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:28.799423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:28.800901 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:28.802808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4649d37d-7d77-4c07-ae3b-7eb1c2abcb44 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.162858 Aug 30 12:12:28.803383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 247/512] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:28 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:29.194865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:29.204411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f66a0585-df36-4ed5-adc5-4e51b60a5cb4 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1722 microversion: 2.1 time: 0.485541 Aug 30 12:12:29.204977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 266/513] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:28 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:29.212110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:29.212110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:29.216199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:29.216199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:29.216199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:29.216199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:29.216503 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:29.216503 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:29.228513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:29.229217 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:29.235247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:29.235815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:29.236418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:29.237091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:29.237626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:29.238110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:29.299881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lazy-loading 'services' on Instance uuid 9e6a4b28-9803-420b-b5a2-febb13ca8b72 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:12:29.481155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:29.489214 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c7987f5f-ef7c-4c90-b8ea-ab2c47ea7ae9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.264413 Aug 30 12:12:29.489798 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 267/514] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:29 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:29.546480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7fde8511-5b4b-4a18-8aab-d9a4ade25465 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72/os-volume_attachments/82a5ada9-f875-4882-aac1-9141178cddcb" status: 202 len: 0 microversion: 2.1 time: 0.344120 Aug 30 12:12:29.547100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 248/515] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:12:29 2022] DELETE /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72/os-volume_attachments/82a5ada9-f875-4882-aac1-9141178cddcb => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:12:29.825942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:29.826549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:29.832562 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:29.833618 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:29.834054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:29.834737 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:29.835189 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:29.835609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:29.966265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:29.974380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:29.975820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:29.976936 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0cb61220-f7f0-4f9a-a544-808ddd7dd20b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.154864 Aug 30 12:12:29.977487 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 268/516] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:29 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:30.228425 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:30.229153 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:30.235340 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:30.235812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:30.236274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:30.236961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:30.237415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:30.237840 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:30.376814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:30.385808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cd384428-246a-4298-b443-f59bfb9d180b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1722 microversion: 2.1 time: 0.162604 Aug 30 12:12:30.386384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 249/517] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:30 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:30.510730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:30.511346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:30.517723 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:30.518198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:30.518628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:30.519308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:30.519758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:30.520215 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:30.655349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:30.663852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a1d4eadb-4ac1-4ca4-80c6-a20e444371f5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.157063 Aug 30 12:12:30.664470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 269/518] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:30 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:30.999456 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:31.000082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:31.006247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:31.006759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:31.007191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:31.007879 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:31.008386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:31.008839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:31.134789 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:31.142783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:31.144299 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:31.145928 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-11bd3bc8-0cdc-4039-af45-94bf30d97d5f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.149870 Aug 30 12:12:31.146555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 250/519] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:30 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:31.406653 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:31.407175 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:31.413369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:31.413855 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:31.414290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:31.414977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:31.415428 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:31.415848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:31.544978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:31.553488 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-749ef697-3dd0-4dc1-975a-68dada70e797 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1722 microversion: 2.1 time: 0.150770 Aug 30 12:12:31.554051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 270/520] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:31 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:31.686485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:31.687089 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:31.693958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:31.694493 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:31.694924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:31.695610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:31.696082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:31.696497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:31.828903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:31.837189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f08ee926-a43a-4c91-89f9-cdf894d957d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.154509 Aug 30 12:12:31.837751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 251/521] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:31 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:32.168390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:32.169140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:32.175314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.175790 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.176415 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.177104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.177567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.178609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.196992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:32.225814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-632e31a8-ce66-49e9-be4c-998a55a958df req-6c31e252-348e-43fd-8e6e-0ed67e2b32d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a946d9a-667e-4a85-bd51-7ffee16f8905", "name": "network-vif-plugged", "status": "completed", "tag": "5634a068-6874-4e11-8b3a-39d600ea396c"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:32.235564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-632e31a8-ce66-49e9-be4c-998a55a958df req-6c31e252-348e-43fd-8e6e-0ed67e2b32d6 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.236066 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-632e31a8-ce66-49e9-be4c-998a55a958df req-6c31e252-348e-43fd-8e6e-0ed67e2b32d6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.236487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-632e31a8-ce66-49e9-be4c-998a55a958df req-6c31e252-348e-43fd-8e6e-0ed67e2b32d6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.249510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-632e31a8-ce66-49e9-be4c-998a55a958df req-6c31e252-348e-43fd-8e6e-0ed67e2b32d6 service nova] Creating event network-vif-plugged:5634a068-6874-4e11-8b3a-39d600ea396c for instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 on hv-cinder-83976 Aug 30 12:12:32.254344 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-632e31a8-ce66-49e9-be4c-998a55a958df req-6c31e252-348e-43fd-8e6e-0ed67e2b32d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Aug 30 12:12:32.254934 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 252/522] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:32.314571 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:32.323287 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:32.324783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:32.325883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f7db400e-ceb0-430d-adb9-b99fe4cde4e1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.161386 Aug 30 12:12:32.326676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 271/523] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:32 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:32.576376 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:32.577076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:32.583656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.585487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.585941 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.586724 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.588498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.588498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.728140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:32.738065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3f8bf46b-fa8e-421c-acb9-c04b1d330680 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1728 microversion: 2.1 time: 0.165939 Aug 30 12:12:32.738637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 253/524] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:32 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:32.760936 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:32.763100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:32.768489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.769016 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.769383 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.770089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.770511 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.770928 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.797963 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:32.798804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:32.805326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.805868 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.809082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.809082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.809082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.809082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.833390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:12:32.850452 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d2495246-0988-495c-b295-20f6216103db tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093704 Aug 30 12:12:32.851042 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 272/525] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:12:32 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:32.861499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:32.862297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:32.869609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.870111 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.870534 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:32.871438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:32.871843 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:32.872295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:33.075045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:33.153423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d27edd59-d55e-47e9-b487-b2806f993782 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 204 len: 0 microversion: 2.1 time: 0.359174 Aug 30 12:12:33.154096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 254/526] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:12:32 2022] DELETE /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 12:12:33.162974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:33.163870 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:33.170559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:33.171252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:33.171689 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:33.172421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:33.172875 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:33.173301 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:33.183172 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:33.191542 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f96ea5b7-d836-408a-8066-2a51f85eacb3 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.337054 Aug 30 12:12:33.192311 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 273/527] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:32 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:33.316104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:33.325182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8a4605f6-85fe-4e40-9878-b7e57ea210a8 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1513 microversion: 2.1 time: 0.166639 Aug 30 12:12:33.325751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 255/528] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:33 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:33.348144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:33.348787 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:33.359466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:33.359969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:33.360418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:33.361145 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:33.361594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:33.362113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:33.571703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:33.580061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:33.581510 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:33.582650 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-30191e76-0494-49f2-9693-33e1d2bcfb06 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.238788 Aug 30 12:12:33.583207 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 274/529] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:33 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:34.037999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-496b745a-3aae-4b65-9f09-ac43eafb2ed3 req-7aeb9c1e-3ddf-4e2f-a996-0f7bfb5132a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fea936-d2d6-4953-9ff2-34c126638e3a", "tag": "d457c16d-f375-456b-a12c-f326f04d9b62"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:34.048500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-496b745a-3aae-4b65-9f09-ac43eafb2ed3 req-7aeb9c1e-3ddf-4e2f-a996-0f7bfb5132a5 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:34.049116 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-496b745a-3aae-4b65-9f09-ac43eafb2ed3 req-7aeb9c1e-3ddf-4e2f-a996-0f7bfb5132a5 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:34.049642 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-496b745a-3aae-4b65-9f09-ac43eafb2ed3 req-7aeb9c1e-3ddf-4e2f-a996-0f7bfb5132a5 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:34.061639 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-496b745a-3aae-4b65-9f09-ac43eafb2ed3 req-7aeb9c1e-3ddf-4e2f-a996-0f7bfb5132a5 service nova] Creating event network-changed:d457c16d-f375-456b-a12c-f326f04d9b62 for instance 38fea936-d2d6-4953-9ff2-34c126638e3a on hv-cinder-83976 Aug 30 12:12:34.067082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-496b745a-3aae-4b65-9f09-ac43eafb2ed3 req-7aeb9c1e-3ddf-4e2f-a996-0f7bfb5132a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033139 Aug 30 12:12:34.067765 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 256/530] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:34.214421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:34.215292 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:34.222297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:34.222864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:34.223371 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:34.224095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:34.224552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:34.225479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:34.347054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:34.347745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:34.354535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:34.355019 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:34.355448 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:34.356169 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:34.356616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:34.357034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:34.365243 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:34.372981 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:12:34.374807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-58fe8e4f-6bf2-418a-822f-4ca9ff0425f7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.164286 Aug 30 12:12:34.375393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 275/531] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:34 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:34.494603 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:34.502534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7a6f7449-a759-43fd-8b13-b068881f5f24 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1513 microversion: 2.1 time: 0.159914 Aug 30 12:12:34.503187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 257/532] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:34 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:34.605537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:34.606171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:34.612310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:34.612788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:34.613218 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:34.613898 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:34.614342 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:34.614757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:34.748612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:34.758135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:34.759702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:34.761089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3ab50720-c1d5-4d20-927d-75fd4cfa9a31 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.159406 Aug 30 12:12:34.761788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 276/533] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:34 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:35.398176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:35.398726 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:35.405146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:35.405618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:35.406045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:35.406714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:35.407160 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:35.407602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:35.524304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:35.524921 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:35.531262 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:35.531743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:35.532209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:35.532905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:35.533358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:35.533778 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:35.534992 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:35.543063 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-29820d04-4a1e-4c80-8eb7-4a58a6ee9e5c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1677 microversion: 2.1 time: 0.149565 Aug 30 12:12:35.547982 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 258/534] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:35 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:35.669702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:35.677614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-47c34582-19f9-4840-993b-58d67020b67f tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1513 microversion: 2.1 time: 0.157428 Aug 30 12:12:35.678944 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 277/535] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:35 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:12:35.784071 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:35.784677 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:35.791298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:35.791909 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:35.792336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:35.793388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:35.793561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:35.793869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:35.928401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:35.936508 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:35.937932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:35.939029 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-67e0e4fc-3ad2-4cf5-8505-59feb4332048 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1406 microversion: 2.20 time: 0.158962 Aug 30 12:12:35.939774 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 259/536] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:35 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:36.082623 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-834658d6-2871-45e7-9eb0-ba2c5ee19737 req-bf110c0b-6fc8-4b33-b00e-3f241587ce93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fea936-d2d6-4953-9ff2-34c126638e3a", "tag": "d457c16d-f375-456b-a12c-f326f04d9b62"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:36.092758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-834658d6-2871-45e7-9eb0-ba2c5ee19737 req-bf110c0b-6fc8-4b33-b00e-3f241587ce93 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.094491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-834658d6-2871-45e7-9eb0-ba2c5ee19737 req-bf110c0b-6fc8-4b33-b00e-3f241587ce93 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.094491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-834658d6-2871-45e7-9eb0-ba2c5ee19737 req-bf110c0b-6fc8-4b33-b00e-3f241587ce93 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:36.105040 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-834658d6-2871-45e7-9eb0-ba2c5ee19737 req-bf110c0b-6fc8-4b33-b00e-3f241587ce93 service nova] Creating event network-changed:d457c16d-f375-456b-a12c-f326f04d9b62 for instance 38fea936-d2d6-4953-9ff2-34c126638e3a on hv-cinder-83976 Aug 30 12:12:36.109992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-834658d6-2871-45e7-9eb0-ba2c5ee19737 req-bf110c0b-6fc8-4b33-b00e-3f241587ce93 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031119 Aug 30 12:12:36.110601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 278/537] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:36.564159 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:36.564819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:36.572205 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.572685 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.573115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:36.573800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.574251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.574669 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:36.702163 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:36.703482 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:36.708793 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:36.711491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.712462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.712899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:36.713606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.714064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.714489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:36.720909 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cd5f5d24-9b2f-43f6-be3e-082475f23323 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1654 microversion: 2.1 time: 0.160590 Aug 30 12:12:36.732165 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 260/538] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:36 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:36.743023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ce405194-c05b-4178-a173-cfb6da67e482 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:36.749353 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce405194-c05b-4178-a173-cfb6da67e482 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.749845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce405194-c05b-4178-a173-cfb6da67e482 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.750816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ce405194-c05b-4178-a173-cfb6da67e482 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:36.773362 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ce405194-c05b-4178-a173-cfb6da67e482 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Going to try to start instance {{(pid=121192) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 12:12:36.933833 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ce405194-c05b-4178-a173-cfb6da67e482 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action" status: 202 len: 0 microversion: 2.1 time: 0.195063 Aug 30 12:12:36.934438 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 261/539] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:12:36 2022] POST /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:12:36.965454 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:36.966158 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:36.975490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.977594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.977594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:36.978925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:36.980598 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:36.981504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:37.018407 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:37.027455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-08daef1c-9c94-421d-acdc-9a38c92909f4 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1513 microversion: 2.1 time: 0.330376 Aug 30 12:12:37.028159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 279/540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:36 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:37.032982 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:37.033594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:37.041280 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:37.043226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:37.044599 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:37.045406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:37.045900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:37.046340 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:37.156214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:37.167241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-70439756-5b64-4f7d-bb65-35e4f5318149 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1663 microversion: 2.1 time: 0.205470 Aug 30 12:12:37.167506 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 262/541] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:36 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1663 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:37.581914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:37.591783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:37.593273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:37.594621 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-67714823-3929-49da-b5eb-9a503e8a60df tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1598 microversion: 2.20 time: 0.565361 Aug 30 12:12:37.595379 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 280/542] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:12:37 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1598 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:12:37.617014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:37.618067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:37.624563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:37.625057 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:37.625485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:37.626170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:37.626622 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:37.627040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:37.710547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-36bb9f73-b839-4829-a7cf-614d3cb89f08 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097671 Aug 30 12:12:37.711145 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 263/543] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Aug 30 12:12:37 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:12:38.049626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:38.050324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:38.061144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:38.061144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:38.061144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:38.061144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:38.061614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:38.061614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:38.099541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:38.100632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:38.101376 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:38.101892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lazy-loading 'fault' on Instance uuid 9e6a4b28-9803-420b-b5a2-febb13ca8b72 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:12:38.135846 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-12af1890-864c-4f10-8b58-d8f99a5cf15a req-f5ee5e3b-6a8a-46a5-91a6-3a8c3762d7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6a4b28-9803-420b-b5a2-febb13ca8b72", "name": "network-vif-deleted", "tag": "85c4b25c-8e31-4cb3-ab29-ec5529256ac3"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:38.145717 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-12af1890-864c-4f10-8b58-d8f99a5cf15a req-f5ee5e3b-6a8a-46a5-91a6-3a8c3762d7bd service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:38.146187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-12af1890-864c-4f10-8b58-d8f99a5cf15a req-f5ee5e3b-6a8a-46a5-91a6-3a8c3762d7bd service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:38.147250 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-12af1890-864c-4f10-8b58-d8f99a5cf15a req-f5ee5e3b-6a8a-46a5-91a6-3a8c3762d7bd service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:38.159543 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-12af1890-864c-4f10-8b58-d8f99a5cf15a req-f5ee5e3b-6a8a-46a5-91a6-3a8c3762d7bd service nova] Creating event network-vif-deleted:85c4b25c-8e31-4cb3-ab29-ec5529256ac3 for instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 on hv-cinder-83976 Aug 30 12:12:38.165277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-12af1890-864c-4f10-8b58-d8f99a5cf15a req-f5ee5e3b-6a8a-46a5-91a6-3a8c3762d7bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034062 Aug 30 12:12:38.170391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 264/544] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:12:38.179153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5312919483f944b29317aa22db224503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24cf8197b5444f6e98b6663a5a08c6dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:38.204734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4908aecb-76c8-43e4-a2fc-46bdae8d132e tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 200 len: 1308 microversion: 2.1 time: 0.158083 Aug 30 12:12:38.205331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 281/545] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:38 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:38.217972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:38.218798 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:38.226384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:38.226774 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:38.227214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:38.228121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:38.228588 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:38.229008 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:38.447112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:38.456434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1e909628-8514-49b7-97de-9d6f049e955e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1663 microversion: 2.1 time: 0.259962 Aug 30 12:12:38.457553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 265/546] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:38 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1663 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:39.001033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-e4d12438-69fa-479b-a460-3aeb1395cd9e req-36525b20-1e26-4eb8-a8d3-98dac377130b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a946d9a-667e-4a85-bd51-7ffee16f8905", "tag": "5634a068-6874-4e11-8b3a-39d600ea396c"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:12:39.011049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-e4d12438-69fa-479b-a460-3aeb1395cd9e req-36525b20-1e26-4eb8-a8d3-98dac377130b service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:39.011523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-e4d12438-69fa-479b-a460-3aeb1395cd9e req-36525b20-1e26-4eb8-a8d3-98dac377130b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:39.011969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-e4d12438-69fa-479b-a460-3aeb1395cd9e req-36525b20-1e26-4eb8-a8d3-98dac377130b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:39.026038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-e4d12438-69fa-479b-a460-3aeb1395cd9e req-36525b20-1e26-4eb8-a8d3-98dac377130b service nova] Creating event network-changed:5634a068-6874-4e11-8b3a-39d600ea396c for instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 on hv-cinder-83976 Aug 30 12:12:39.031054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-e4d12438-69fa-479b-a460-3aeb1395cd9e req-36525b20-1e26-4eb8-a8d3-98dac377130b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033891 Aug 30 12:12:39.031702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 282/547] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:12:39.226715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:39.227297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] [instance: 9e6a4b28-9803-420b-b5a2-febb13ca8b72] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:39.233651 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:39.234137 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:39.234573 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:39.235263 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:39.235780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:39.236231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:39.250572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] HTTP exception thrown: Instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 could not be found. Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Request method failure captured: Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 HTTP/1.1 Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf4d5o1jvyydGNRgqyby42T2J0QuFxck244A3mOaYM2or5YSckgAUAbx3nryfsZl_ZvjKaW2EzhdYEJHE-Wn3-_nEN4JEyS8ZHQR_NG9ywTQyZqF29Kkd8fWa5b6q_p_JOJAFOV4i9pd3MXFEeSOZU75udv6wJjYtga29PHan4qO0EY Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 24cf8197b5444f6e98b6663a5a08c6dc Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1534570253 Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:12:39.252881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/24cf8197b5444f6e98b6663a5a08c6dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesSnapshotTestJSON-1534570253 Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 24cf8197b5444f6e98b6663a5a08c6dc Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1534570253 Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesSnapshotTestJSON-1534570253-project Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 5312919483f944b29317aa22db224503 Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesSnapshotTestJSON-1534570253-project Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 could not be found. Aug 30 12:12:39.254435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '9e6a4b28-9803-420b-b5a2-febb13ca8b72'} Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 could not be found. Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:12:39.255326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 could not be found. Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 could not be found. Aug 30 12:12:39.257368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:12:39.259712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] Returning 404 to user: Instance 9e6a4b28-9803-420b-b5a2-febb13ca8b72 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:12:39.259712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4774387d-8faa-46a8-878d-7a54a66418f9 tempest-VolumesSnapshotTestJSON-1534570253 tempest-VolumesSnapshotTestJSON-1534570253-project] 10.222.0.42 "GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72" status: 404 len: 111 microversion: 2.1 time: 0.031826 Aug 30 12:12:39.259712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 266/548] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:39 2022] GET /compute/v2.1/servers/9e6a4b28-9803-420b-b5a2-febb13ca8b72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 12:12:39.480054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:39.480759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:39.488079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:39.488823 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:39.489461 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:39.490162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:39.490726 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:39.491151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:39.725889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:39.736569 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-61691cd0-3975-4dbb-a2b4-3ae5d1c1a4c2 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1663 microversion: 2.1 time: 0.261511 Aug 30 12:12:39.743359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 283/549] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:39 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1663 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:12:40.757590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:12:40.758201 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:12:40.764734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:40.765216 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:40.765646 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:40.766356 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:12:40.766811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:12:40.767229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:12:40.899232 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:12:40.907093 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-30535dc9-0af0-48a1-a460-5209a8edc307 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1667 microversion: 2.1 time: 0.153519 Aug 30 12:12:40.907880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 267/550] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:12:40 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:15.150592 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 12:13:15.151089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Tue Aug 30 12:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/ips (ip 10.222.0.42) !!! Aug 30 12:13:15.153180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=57 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:15.154756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=66 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:15.216057 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:15.217177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:15.223352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=27 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:15.224521 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:15.227111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:15.227801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:15.228473 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:15.229323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:15.230001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:15.230634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:15.385568 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:15.386666 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:15.395444 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:15.395964 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:15.396710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:15.397431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:15.397890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:15.398322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:15.410415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lazy-loading 'services' on Instance uuid 38fea936-d2d6-4953-9ff2-34c126638e3a {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:15.426703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e8bf86aa-8e83-4173-b2fa-c5fd607ee6c3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/ips" status: 200 len: 151 microversion: 2.20 time: 0.284443 Aug 30 12:13:15.434439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 284/551] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Aug 30 12:13:15 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/ips => generated 151 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:13:15.625308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-25bfcabb-2870-4e0a-a9f1-0125fe45bc7e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments/accbe19b-7e48-4be6-a248-585861184019" status: 202 len: 0 microversion: 2.1 time: 0.413236 Aug 30 12:13:15.629374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 268/552] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:13:15 2022] DELETE /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments/accbe19b-7e48-4be6-a248-585861184019 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:13:15.634699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:15.637234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:15.645916 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:15.646681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:15.647155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:15.647854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:15.648548 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:15.648979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:15.682908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0f3d57fe-0681-4780-8c85-8266de421067 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052269 Aug 30 12:13:15.683546 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 285/553] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:13:15 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:16.696059 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:16.698376 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:16.706562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:16.707060 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:16.707508 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:16.708402 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:16.708856 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:16.709282 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:16.745664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-02e9dff5-b08a-4ac7-939a-a1519f17d131 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054440 Aug 30 12:13:16.746748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 269/554] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:13:16 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:17.758917 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:17.762037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:17.770020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:17.770734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:17.771514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:17.772623 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:17.773228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:17.773806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:17.806499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3a4400a3-3de7-4525-992b-f0cc3bf0b9a6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051395 Aug 30 12:13:17.807625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 286/555] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:13:17 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:13:17.900097 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:17.900645 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:17.909562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:17.910134 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:17.910785 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:17.911705 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:17.912641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:17.912641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:17.944958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:13:18.118489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:18.119183 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:18.127255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:18.127764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:18.128231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:18.129020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:18.129377 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:18.130048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:18.154132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lazy-loading 'flavor' on Instance uuid 9a946d9a-667e-4a85-bd51-7ffee16f8905 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:18.339112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7bd0fab6-da10-48ab-8cc9-616323d6739f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "DELETE /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 204 len: 0 microversion: 2.1 time: 0.443358 Aug 30 12:13:18.340825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 270/556] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:13:17 2022] DELETE /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:13:18.352527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:18.353647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:18.368273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:18.369997 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:18.370422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:18.373560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:18.374975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:18.392946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:18.622520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:18.641506 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-adca3ed8-cc03-44ee-8c02-b48dc26e09c8 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1688 microversion: 2.1 time: 0.295794 Aug 30 12:13:18.642841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 271/557] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:18 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1688 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:18.822403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0baf3f94-a3b5-4db4-92ab-53eec93665c5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/action" status: 202 len: 0 microversion: 2.20 time: 0.707773 Aug 30 12:13:18.822998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 287/558] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Aug 30 12:13:18 2022] POST /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 12:13:18.832296 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:18.833006 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:18.839160 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:18.839639 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:18.840101 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:18.840790 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:18.841261 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:18.842260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.101934 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:19.114437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:19.117616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:19.119207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-acdce126-c9b8-4c5c-9c7f-97f4fa9af601 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.290844 Aug 30 12:13:19.120275 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 272/559] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:18 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:19.210478 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:19.223876 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:19.225889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.226574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.227201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.231157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.231820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.232579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.269882 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-00559302-2c3a-46f5-bd7c-3f8262c232fa tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064816 Aug 30 12:13:19.275614 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 288/560] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:13:19 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:13:19.353309 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:19.354251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:19.362342 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.362876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.366641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.366641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.366641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.366641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.398126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:13:19.665503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:19.666473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:19.673198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.673684 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.674118 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.674822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.675437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.675859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.684671 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d419480e-0a3b-4f56-995a-08aa7f559a98 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 204 len: 0 microversion: 2.1 time: 0.336147 Aug 30 12:13:19.685258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 273/561] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:13:19 2022] DELETE /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:13:19.695771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:19.698293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:19.705635 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.706336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.707095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.709051 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:19.709956 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:19.710549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:19.871202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:19.882292 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5d1b8eae-ec60-4429-9dfd-e6eab9a642ec tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1688 microversion: 2.1 time: 0.221111 Aug 30 12:13:19.883626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 289/562] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:19 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:19.899683 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:19.911754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bfa79509-80fd-41e7-91be-c9c1d28b9438 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1673 microversion: 2.1 time: 0.220633 Aug 30 12:13:19.926830 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 274/563] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:19 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:20.145139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:20.145882 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:20.156489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:20.157090 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:20.158265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:20.160853 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:20.162743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:20.163384 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:20.330666 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:20.338942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:20.340595 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:20.341915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9d1dd9e8-55e8-4060-aef9-22926a64e8bd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.202204 Aug 30 12:13:20.342487 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 290/564] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:20 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:20.910909 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:20.912196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:20.922163 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:20.922921 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:20.923518 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:20.924610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:20.925238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:20.925828 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:20.934124 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:20.934998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:20.948343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:20.948848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:20.949284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:20.949992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:20.950452 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:20.951115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:21.111552 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:21.119630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:21.128820 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4c39f44c-854c-4627-b87b-1b6f05b4ea9f tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1688 microversion: 2.1 time: 0.225225 Aug 30 12:13:21.133318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1c2c107d-e437-4a05-b62f-712923b061f0 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1673 microversion: 2.1 time: 0.201453 Aug 30 12:13:21.135678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 291/565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:20 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:21.143074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 275/566] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:20 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:21.365789 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:21.366828 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:21.374765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:21.375539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:21.378331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:21.378331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:21.378331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:21.378331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:21.572477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:21.582821 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:21.584539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:21.586090 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dd5c17af-863d-4d29-b2c0-46e10fb403aa tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.224615 Aug 30 12:13:21.587119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 292/567] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:21 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:22.153972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:22.155428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:22.162756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:22.163533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:22.174435 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:22.176994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:22.177828 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:22.178497 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:22.179242 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:22.180251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:22.180932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:22.181622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:22.182590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:22.183230 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:22.185947 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:22.190652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:22.416215 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:22.424859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-72099d5e-b5c0-4d4e-b727-555941fb71d7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1673 microversion: 2.1 time: 0.266125 Aug 30 12:13:22.428074 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 293/568] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:22 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:22.450652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:22.460660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-09b57965-7b88-4ff8-b390-2db108137965 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1688 microversion: 2.1 time: 0.310767 Aug 30 12:13:22.476060 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 276/569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:22 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1688 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:22.619350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:22.620276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:22.627605 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:22.628404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:22.629003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:22.629897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:22.630511 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:22.631094 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:22.800016 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:22.812255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:22.814265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:22.815828 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6101c359-d730-4680-8d73-9d4b248c4295 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.200416 Aug 30 12:13:22.817226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 294/570] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:22 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:23.448634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:23.449188 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:23.456308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:23.456803 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:23.457239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:23.457942 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:23.458402 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:23.458830 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:23.482910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:23.483632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:23.490547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:23.490820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:23.491260 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:23.491984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:23.492447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:23.492877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:23.629194 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:23.637373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4bc3db63-1862-4fe0-821c-ef2ce7cae56e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1673 microversion: 2.1 time: 0.192698 Aug 30 12:13:23.638426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 277/571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:23 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:23.791754 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:23.800746 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-330a3e3c-bda6-49b3-b5a0-40ba3374cf41 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1688 microversion: 2.1 time: 0.321893 Aug 30 12:13:23.802425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 295/572] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:23 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1688 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:23.839391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:23.840012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:23.846701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:23.847534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:23.848065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:23.848835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:23.849560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:23.850338 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:24.019383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:24.033168 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:24.035047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:24.036558 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8e82a2b1-dd63-40b9-8100-087906956dd9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.201255 Aug 30 12:13:24.037992 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 278/573] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:23 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:24.663775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:24.665090 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:24.672824 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:24.673758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:24.674229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:24.675156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:24.675617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:24.676065 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:24.823413 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:24.824325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:24.834878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:24.835634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:24.836341 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:24.837736 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:24.839983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:24.840643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:24.926165 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:24.934423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ccc9d867-325b-4c88-9720-0ed71bcd5150 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1621 microversion: 2.1 time: 0.115296 Aug 30 12:13:24.936161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 279/574] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:24 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1621 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:25.061546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:25.064318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:25.068983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:25.080473 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:25.081328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ef16f329-3ce8-4d93-a79b-7e69038c6485 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1673 microversion: 2.1 time: 0.419894 Aug 30 12:13:25.081936 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 296/575] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:24 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1673 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:25.083035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:25.083722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:25.085075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:25.085881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:25.086924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:25.127770 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:25.294367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:25.305677 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:25.319485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:25.325211 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dd310980-8daa-4ce9-bbd4-9700771a4b75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.268002 Aug 30 12:13:25.331887 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 280/576] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:25 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:25.604783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-ffa58677-5bb0-4644-92c4-635f78ca3976 req-5dbba253-5000-4ba5-982e-58884eb35c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fea936-d2d6-4953-9ff2-34c126638e3a", "name": "network-vif-deleted", "tag": "d457c16d-f375-456b-a12c-f326f04d9b62"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:25.634710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-ffa58677-5bb0-4644-92c4-635f78ca3976 req-5dbba253-5000-4ba5-982e-58884eb35c4c service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:25.642887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-ffa58677-5bb0-4644-92c4-635f78ca3976 req-5dbba253-5000-4ba5-982e-58884eb35c4c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:25.645042 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-ffa58677-5bb0-4644-92c4-635f78ca3976 req-5dbba253-5000-4ba5-982e-58884eb35c4c service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:25.680782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-ffa58677-5bb0-4644-92c4-635f78ca3976 req-5dbba253-5000-4ba5-982e-58884eb35c4c service nova] Creating event network-vif-deleted:d457c16d-f375-456b-a12c-f326f04d9b62 for instance 38fea936-d2d6-4953-9ff2-34c126638e3a on hv-cinder-83976 Aug 30 12:13:25.716066 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-ffa58677-5bb0-4644-92c4-635f78ca3976 req-5dbba253-5000-4ba5-982e-58884eb35c4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264369 Aug 30 12:13:25.718039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 297/577] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:25.960245 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:25.960982 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:25.983118 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:25.984311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:25.984836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:25.987346 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:26.003851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:26.007297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:26.087038 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:26.089281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:26.089281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:26.089281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lazy-loading 'fault' on Instance uuid 38fea936-d2d6-4953-9ff2-34c126638e3a {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:26.105503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:26.106617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:26.132260 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:26.132886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:26.133436 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:26.136451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:26.139335 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:26.139335 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:26.171531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:26.184270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b8b0ad42-eb50-4358-8458-3e9bbe9af410 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 200 len: 1335 microversion: 2.1 time: 0.226266 Aug 30 12:13:26.185260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 281/578] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:25 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 1335 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:26.213276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:26.213742 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:26.214287 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:26.216864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lazy-loading 'fault' on Instance uuid 17fac3ff-6458-4118-994c-d9eebd1b8a30 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:26.300820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:26.311749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-188ee9de-69a7-48a5-a8ba-0975d7310d08 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1327 microversion: 2.1 time: 0.212046 Aug 30 12:13:26.319852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 298/579] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:26 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:26.353904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:26.354559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:26.365652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:26.366153 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:26.366591 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:26.367292 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:26.367744 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:26.372305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:26.664405 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:26.677772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:26.681102 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:26.682768 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-999a36fd-536d-4c91-b36e-1e0cc5953d4a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.333043 Aug 30 12:13:26.683833 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 282/580] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:26 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:27.210625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:27.211772 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 38fea936-d2d6-4953-9ff2-34c126638e3a] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:27.223896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.232737 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.233324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.234169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.234739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.235276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.252388 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:27.254148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] HTTP exception thrown: Instance 38fea936-d2d6-4953-9ff2-34c126638e3a could not be found. Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Request method failure captured: Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a HTTP/1.1 Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2chFL7TTDwBqSSUV8iHuKCFNI9kKGw22-zu3q6bTt-658jo2vyt5oBlVcxKaJsHKfjJjzYa9xyikpmnUk2gSMTEKNjyQmyznycs6wSfrKqi2r_B-Slk13ypWUgPlEVY35EcNk2EtR1HiHVw50oruSpIXKm9bZWchHF3EIyqM_E5_A Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:13:27.255774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c040647b03574d3a87a335e10d02ef49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 012ead000e8d411eae7034f296455fe7 Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 38fea936-d2d6-4953-9ff2-34c126638e3a could not be found. Aug 30 12:13:27.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '38fea936-d2d6-4953-9ff2-34c126638e3a'} Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38fea936-d2d6-4953-9ff2-34c126638e3a could not be found. Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:13:27.258528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38fea936-d2d6-4953-9ff2-34c126638e3a could not be found. Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38fea936-d2d6-4953-9ff2-34c126638e3a could not be found. Aug 30 12:13:27.260231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:27.276726 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Returning 404 to user: Instance 38fea936-d2d6-4953-9ff2-34c126638e3a could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:13:27.277866 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8f02f4ea-ad35-4035-8537-393f73518c05 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a" status: 404 len: 111 microversion: 2.1 time: 0.071133 Aug 30 12:13:27.278939 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 299/581] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:27 2022] GET /compute/v2.1/servers/38fea936-d2d6-4953-9ff2-34c126638e3a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:13:27.288793 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fad4ec19-8b3a-4377-a97d-359a8bd1af81 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '.version_select at 0x7efe4ef04310>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:27.346325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:27.346325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:27.352941 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.356068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.356068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.356068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.356068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.356535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.379275 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fad4ec19-8b3a-4377-a97d-359a8bd1af81 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177257713" status: 202 len: 0 microversion: 2.1 time: 0.095508 Aug 30 12:13:27.381212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 283/582] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Aug 30 12:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177257713 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:13:27.428430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.429892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.431724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.432477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lazy-loading 'fault' on Instance uuid 17fac3ff-6458-4118-994c-d9eebd1b8a30 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:27.492500 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:27.501115 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5d4ea6bf-e448-4d86-a8d4-ba6aa6f8d17a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 200 len: 1327 microversion: 2.1 time: 0.160204 Aug 30 12:13:27.505820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 300/583] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:27 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 1327 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:27.710360 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:27.712656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:27.721063 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.721951 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.722601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.723528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.724226 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.725163 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.764852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-29e0a7b8-6df1-47ed-a345-15891a5fc9a4 req-6b4d5447-224d-41f7-82f4-229f97fd18f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17fac3ff-6458-4118-994c-d9eebd1b8a30", "name": "network-vif-deleted", "tag": "d9f16a23-193f-4540-a8ab-c5ee53e24e8e"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:27.784843 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-29e0a7b8-6df1-47ed-a345-15891a5fc9a4 req-6b4d5447-224d-41f7-82f4-229f97fd18f1 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:27.785324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-29e0a7b8-6df1-47ed-a345-15891a5fc9a4 req-6b4d5447-224d-41f7-82f4-229f97fd18f1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:27.785761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-29e0a7b8-6df1-47ed-a345-15891a5fc9a4 req-6b4d5447-224d-41f7-82f4-229f97fd18f1 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:27.799776 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-29e0a7b8-6df1-47ed-a345-15891a5fc9a4 req-6b4d5447-224d-41f7-82f4-229f97fd18f1 service nova] Creating event network-vif-deleted:d9f16a23-193f-4540-a8ab-c5ee53e24e8e for instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 on hv-cinder-83976 Aug 30 12:13:27.817313 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-29e0a7b8-6df1-47ed-a345-15891a5fc9a4 req-6b4d5447-224d-41f7-82f4-229f97fd18f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059638 Aug 30 12:13:27.818185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 301/584] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:13:28.014594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:28.024473 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:28.026063 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:28.027486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2668779d-96f2-450e-b2bc-ad748448f513 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.324086 Aug 30 12:13:28.028146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 284/585] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:27 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:28.148785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:28.149360 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:28.155743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:28.156251 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:28.156685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:28.157365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:28.157813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:28.158228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:28.193531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:13:28.509026 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e7817693-6a97-4c39-96cb-a7770f9a19c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "DELETE /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 204 len: 0 microversion: 2.1 time: 0.360349 Aug 30 12:13:28.510289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 302/586] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:13:28 2022] DELETE /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:13:28.522475 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:28.524030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:28.524226 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:28.527186 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:28.540410 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:28.542170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:28.543449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:28.544598 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:28.546635 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:28.547332 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:28.567665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:28.571310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:28.575380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:28.575380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:28.575712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:28.576055 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:28.646691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] HTTP exception thrown: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Request method failure captured: Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 HTTP/1.1 Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf3w_fO86aHLQ0Ek6v8HP_HA_q9cj_WeOkMwOsPhF-jQjwN0wfbtOqvHSJxkoe09edbOYJwqbl7sbOHxY8vf0nLvu14JhuO5JIZchkv2xqY-s431Mdsx40t0iSHytHTIX44wac1ez6kZpPOi-oNqu48QQLxysIwll1mj80hWa_ZwGFI Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:13:28.651167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 04a0c4a52ae34e71bda4903c305b58a4 Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:13:28.652771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '17fac3ff-6458-4118-994c-d9eebd1b8a30'} Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:13:28.653593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:13:28.655320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:28.664638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Returning 404 to user: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:13:28.667848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-32bae117-51ea-4cb4-8fe1-c95954fc55ec tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 404 len: 111 microversion: 2.1 time: 0.149282 Aug 30 12:13:28.676962 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 303/587] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:28 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:13:28.686869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bd564198-4af7-4917-88eb-3be3daacfb6a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '.version_select at 0x7efe4ee0e3a0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:28.785687 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:28.793795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a73eb770-0614-4cf3-bbaf-3b6b0323997d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1578 microversion: 2.1 time: 0.278430 Aug 30 12:13:28.807624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 285/588] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:28 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1578 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:28.836025 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bd564198-4af7-4917-88eb-3be3daacfb6a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865461256" status: 202 len: 0 microversion: 2.1 time: 0.157106 Aug 30 12:13:28.836714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 304/589] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Aug 30 12:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865461256 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:13:29.057949 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:29.058853 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:29.066816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:29.067480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:29.068147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:29.068946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:29.069522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:29.070801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:29.267169 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:29.286047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:29.287526 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:29.290880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4007d3cc-20b4-43ed-9741-8ad49692e506 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.239181 Aug 30 12:13:29.295690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 286/590] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:29 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:29.815497 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:29.817101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:29.825136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:29.825624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:29.826910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:29.828008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:29.828538 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:29.829161 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:30.057037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:30.074585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b5a27ca0-c938-470c-ae3d-b353f6920a26 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1578 microversion: 2.1 time: 0.262721 Aug 30 12:13:30.083130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 305/591] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:29 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1578 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:30.144765 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2925d41f-7549-4ade-967a-61a76e7af83f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'create', calling method: .version_select at 0x7efe4eed2790>, body: {"keypair": {"name": "tempest-keypair-748835344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbPT04rQtSmKLiV9uPlkCZvrlqo9LlMGASPB+jVltMm5rQF13p1kPNNZysbW8klVeiDONgcYHEH26Yb+0bwk5w293LNoqg0xLEEapzB7fj5DaiYhNrUpuBmzHEfRQ49aA=="}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:30.168661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-2925d41f-7549-4ade-967a-61a76e7af83f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:13:30.174126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-2925d41f-7549-4ade-967a-61a76e7af83f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for user 04a0c4a52ae34e71bda4903c305b58a4 and project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:13:30.264137 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2925d41f-7549-4ade-967a-61a76e7af83f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123142 Aug 30 12:13:30.271652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 287/592] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:13:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:30.314759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:30.315650 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:30.331460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:30.331973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:30.332671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:30.333615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:30.334234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:30.334811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:30.662649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:30.677836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:30.680141 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:30.681516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e10f0233-15c9-455d-974c-8d0d28f91757 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.371692 Aug 30 12:13:30.682560 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 306/593] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:30 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:31.099986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:31.099986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:31.110254 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:31.111186 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:31.111186 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:31.112556 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:31.113236 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:31.113727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:31.150052 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:31.150642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:31.158818 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:31.159707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:31.159867 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:31.166940 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:31.167443 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:31.168102 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:31.200860 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:13:31.299132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:31.307228 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ded3ad4a-7213-4546-b4b7-cbd3a77ff535 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1578 microversion: 2.1 time: 0.214969 Aug 30 12:13:31.308819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 288/594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:31 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:31.629012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-0b06e764-f3d1-486b-8aa2-96dc09dfcbec req-8dd09fc5-d428-4af0-bcd8-5edca3b1b3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423f83c5-b199-43bd-a57f-0c208ac1c44e", "name": "network-vif-deleted", "tag": "365df129-d1af-439d-a5be-0382853d90e2"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:31.629258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0b06e764-f3d1-486b-8aa2-96dc09dfcbec req-8dd09fc5-d428-4af0-bcd8-5edca3b1b3fe service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:31.630094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0b06e764-f3d1-486b-8aa2-96dc09dfcbec req-8dd09fc5-d428-4af0-bcd8-5edca3b1b3fe service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:31.630520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0b06e764-f3d1-486b-8aa2-96dc09dfcbec req-8dd09fc5-d428-4af0-bcd8-5edca3b1b3fe service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:31.643801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-0b06e764-f3d1-486b-8aa2-96dc09dfcbec req-8dd09fc5-d428-4af0-bcd8-5edca3b1b3fe service nova] Creating event network-vif-deleted:365df129-d1af-439d-a5be-0382853d90e2 for instance 423f83c5-b199-43bd-a57f-0c208ac1c44e on hv-cinder-83976 Aug 30 12:13:31.649243 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-0b06e764-f3d1-486b-8aa2-96dc09dfcbec req-8dd09fc5-d428-4af0-bcd8-5edca3b1b3fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033361 Aug 30 12:13:31.650041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 289/595] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:13:31.706941 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:31.708158 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:31.715213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:31.718618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:31.719107 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:31.719813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:31.720297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:31.720726 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:31.988854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c5df32fe-9579-4409-afeb-a4e36ea4f5b3 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "DELETE /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 204 len: 0 microversion: 2.1 time: 0.842840 Aug 30 12:13:31.996211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 307/596] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:13:31 2022] DELETE /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 0 bytes in 845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:13:32.004845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:32.006289 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:32.007056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:32.016563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:32.018059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:32.018059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:32.018252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:32.018347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:32.019157 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4e59fce2-2337-4882-93b5-7eb372ba78be tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.316543 Aug 30 12:13:32.019315 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:32.019781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 290/597] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:31 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:32.024535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:32.025734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:32.209544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:32.219051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a1f72e5c-ac38-4d3d-a916-f7337b1636b6 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1505 microversion: 2.1 time: 0.220152 Aug 30 12:13:32.231357 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 308/598] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:31 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:32.330307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:32.331323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:32.340781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:32.341436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:32.344783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:32.349844 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:32.350631 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:32.351074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:32.440200 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:32.451784 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9b8e2752-8d06-4991-93a2-5899e17e023b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1226 microversion: 2.1 time: 0.125449 Aug 30 12:13:32.453660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 291/599] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:32 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:32.924684 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-adaee331-895a-4129-98fc-800de0fa64b5 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Action: 'create', calling method: .version_select at 0x7efe4eeaf3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-492312201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUCEbYqsFfF3Awz2L+ziHwBycQkwzM7uRN7R5MZnJfcofkuP9nKkIog4oekDTlwXFTujXzyu+nUVd9BKoa5LeXFJ8vm+yojb6orRGxbrzurNmUOJ3I+FRMTbKystWxFmQ=="}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:32.941850 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-adaee331-895a-4129-98fc-800de0fa64b5 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Getting quotas for project 66ad307771aa4815a2c5d81606f60ba8. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:13:32.945878 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-adaee331-895a-4129-98fc-800de0fa64b5 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Getting quotas for user 7bb9322155fc48108ffb2c52b1f684b6 and project 66ad307771aa4815a2c5d81606f60ba8. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:13:33.037846 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-adaee331-895a-4129-98fc-800de0fa64b5 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.121722 Aug 30 12:13:33.038979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 309/600] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:13:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:33.042593 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:33.043195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:33.050062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.050545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.050975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.052079 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.052177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.052539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.093462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-394097705", "imageRef": "d52563da-4dd9-405f-af79-9a79ba2fc907", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-492312201", "networks": [{"uuid": "e83a9d24-41bc-4cbe-ad52-609d7413ed1c"}]}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:33.152382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] validate_networks() for [('e83a9d24-41bc-4cbe-ad52-609d7413ed1c', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:13:33.271752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:33.280614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:33.282463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:33.283805 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-98794da5-bd6a-4677-a5cd-60cb0d477eff tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.245095 Aug 30 12:13:33.284618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 292/601] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:33 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:33.290111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:33.290869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:33.297536 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.298018 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.298441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.299127 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.299575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.300028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.480038 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:33.488839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-61964e1b-a811-4401-bf10-15cafdcb07fa tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1505 microversion: 2.1 time: 0.202715 Aug 30 12:13:33.489522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 293/602] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:33 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:33.494303 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:33.494972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:33.502017 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.502572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.503072 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.503829 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.504352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.504773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.537194 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.537675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.538103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.538547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lazy-loading 'fault' on Instance uuid 423f83c5-b199-43bd-a57f-0c208ac1c44e {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:33.585360 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:33.593639 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-95683d15-5290-4c56-aa71-0d9f561ddfb4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1231 microversion: 2.1 time: 0.102952 Aug 30 12:13:33.594395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 294/603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:33 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:33.656326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-289042004", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb3dfe21-67bc-46c0-8929-2517d26faf12"}], "security_groups": [{"name": "tempest-securitygroup--1695543122"}], "key_name": "tempest-keypair-748835344", "user_data": "}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:33.668194 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:13:33.668681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:13:33.669200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:13:33.669673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:13:33.671034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:13:33.679877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.680553 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.680984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.681705 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:33.682155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:33.682571 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:33.703645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Getting quotas for project 66ad307771aa4815a2c5d81606f60ba8. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:13:33.707837 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Getting quotas for user 7bb9322155fc48108ffb2c52b1f684b6 and project 66ad307771aa4815a2c5d81606f60ba8. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:13:33.719372 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:13:33.721643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d52563da-4dd9-405f-af79-9a79ba2fc907',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:13:33.760759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] validate_networks() for [('cb3dfe21-67bc-46c0-8929-2517d26faf12', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:13:33.882450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4a975a14-8fc7-437f-9d91-370fb96ec22f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794130 Aug 30 12:13:33.883069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 310/604] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 12:13:33.897514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-eab93186-05e2-4b2c-b48f-1668169ed608 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:33.897992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-eab93186-05e2-4b2c-b48f-1668169ed608 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:33.901259 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:33.980699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-eab93186-05e2-4b2c-b48f-1668169ed608 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:33.995563 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-eab93186-05e2-4b2c-b48f-1668169ed608 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1257 microversion: 2.1 time: 0.102046 Aug 30 12:13:33.996174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 311/605] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:33 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1257 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:34.289197 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:13:34.289621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:13:34.290201 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:13:34.290749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:13:34.291162 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:13:34.301266 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.302202 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.302855 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.304481 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.305174 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.305793 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.308093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:34.311606 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:34.323578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.324880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.325363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.326070 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.326866 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.327441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.328258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:13:34.334780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Getting quotas for user 04a0c4a52ae34e71bda4903c305b58a4 and project 56e118000fea4e5e91d716d7612bb9e3. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:13:34.347474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:13:34.351708 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:13:34.380209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:34.475188 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3e17d603-37f0-4d46-8714-0c67cc8de62a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.823166 Aug 30 12:13:34.476212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 295/606] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:13:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 12:13:34.486932 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f166a33e-7416-49d7-a10d-3fcbe560ce76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:34.487674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f166a33e-7416-49d7-a10d-3fcbe560ce76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:34.551892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:34.562571 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:34.566888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:34.572154 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fb813653-a1c7-4aef-b57a-87f2e0395f4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1743 microversion: 2.20 time: 0.264770 Aug 30 12:13:34.582602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 312/607] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:34 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1743 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:34.587508 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f166a33e-7416-49d7-a10d-3fcbe560ce76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:34.589148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:34.589148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:34.595446 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.596157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.596747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.597625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.598264 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.598838 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.601570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f166a33e-7416-49d7-a10d-3fcbe560ce76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1236 microversion: 2.1 time: 0.118423 Aug 30 12:13:34.602745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 296/608] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:34 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1236 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:34.616176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-0f57c786-309b-4642-9b24-6878a684ebf9 req-b48b312b-3d2a-44c8-8557-94a0c5a81940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393867e8-3598-4477-a515-e0e91f5ff5df", "name": "network-vif-deleted", "tag": "bd985017-5118-4030-bf51-25ac4f9eb763"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:34.633545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0f57c786-309b-4642-9b24-6878a684ebf9 req-b48b312b-3d2a-44c8-8557-94a0c5a81940 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.639198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0f57c786-309b-4642-9b24-6878a684ebf9 req-b48b312b-3d2a-44c8-8557-94a0c5a81940 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.639879 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0f57c786-309b-4642-9b24-6878a684ebf9 req-b48b312b-3d2a-44c8-8557-94a0c5a81940 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.664222 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-0f57c786-309b-4642-9b24-6878a684ebf9 req-b48b312b-3d2a-44c8-8557-94a0c5a81940 service nova] Creating event network-vif-deleted:bd985017-5118-4030-bf51-25ac4f9eb763 for instance 393867e8-3598-4477-a515-e0e91f5ff5df on hv-cinder-83976 Aug 30 12:13:34.673801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-0f57c786-309b-4642-9b24-6878a684ebf9 req-b48b312b-3d2a-44c8-8557-94a0c5a81940 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069598 Aug 30 12:13:34.674748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 297/609] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:34.681790 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:34.684390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:34.695148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:34.702715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.703551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.704199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.705447 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.706074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.706549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cafc624e-9daa-4db0-b129-5cd57a72a31d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1463 microversion: 2.1 time: 0.121870 Aug 30 12:13:34.707636 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.710418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 313/610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:34 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1463 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:34.775499 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:34.776844 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:34.777513 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:34.778311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lazy-loading 'fault' on Instance uuid 423f83c5-b199-43bd-a57f-0c208ac1c44e {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:34.831079 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:34.838928 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f0dd586c-6bd4-4804-a436-4993d0c4bc4d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 200 len: 1185 microversion: 2.1 time: 0.163019 Aug 30 12:13:34.839602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 298/611] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:34 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 1185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:35.018969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c16515f5-2b55-4594-9f08-1c7e7fd52435 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:35.018969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c16515f5-2b55-4594-9f08-1c7e7fd52435 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:35.077787 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c16515f5-2b55-4594-9f08-1c7e7fd52435 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:35.084958 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c16515f5-2b55-4594-9f08-1c7e7fd52435 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1257 microversion: 2.1 time: 0.071694 Aug 30 12:13:35.085527 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 314/612] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:35 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:35.596919 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:35.597546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:35.606420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:35.606913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:35.607455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:35.608343 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:35.608998 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:35.609429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:35.622878 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-413021f1-9f92-456e-be66-6769d7f66de5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:35.624252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-413021f1-9f92-456e-be66-6769d7f66de5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:35.677130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-413021f1-9f92-456e-be66-6769d7f66de5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:35.685147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-413021f1-9f92-456e-be66-6769d7f66de5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1236 microversion: 2.1 time: 0.066312 Aug 30 12:13:35.686459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 315/613] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:35 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:35.731185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:35.731823 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:35.738969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:35.739468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:35.739905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:35.740730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:35.741143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:35.741568 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:35.747976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:35.757378 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:35.758802 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:35.759958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-70e435fc-a8fd-49c4-a047-c77d0673411e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1743 microversion: 2.20 time: 0.167040 Aug 30 12:13:35.760528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 299/614] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:35 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:35.774148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:35.774632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:35.775074 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:35.775514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lazy-loading 'fault' on Instance uuid 393867e8-3598-4477-a515-e0e91f5ff5df {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:35.818160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:35.825908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1b11eec6-d8bb-49ca-aafb-2d2f4f911fcd tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 200 len: 1309 microversion: 2.1 time: 0.098712 Aug 30 12:13:35.827197 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 316/615] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:35 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:35.861329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:35.861931 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:35.868096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:35.868575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:35.869185 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:35.869882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:35.870311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:35.870725 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:35.885400 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] HTTP exception thrown: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Request method failure captured: Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e HTTP/1.1 Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf4RXHcRQfA68tpXAfIkGgPGX3tSrBs-sbTzpWnNEQyofEKC5kitEEOoNVI4IWbmKc0g3wWPO68UDRfQ5Zyfb9AgnI-fxYAs-8aYWbkRa6zFKWiY39eO0B5WtU3x984eIMtYdio0C5O9HsSe3PBR2pDtLrqfFrDhNGQG1nyTJhYDHP4 Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:13:35.887313 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 3733f8f0d14746949cbe92c9d370c33e Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:13:35.894046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '423f83c5-b199-43bd-a57f-0c208ac1c44e'} Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:13:35.894913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:13:35.896121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:35.897161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Returning 404 to user: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:13:35.897161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4e398c6d-700c-4e99-a3a8-05e967b02c29 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 404 len: 111 microversion: 2.1 time: 0.031717 Aug 30 12:13:35.897161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 300/616] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:35 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:13:35.991918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1760790676", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1243030642", "security_groups": [{"name": "tempest-secgroup-smoke-275745598"}], "block_device_mapping_v2": [{"uuid": "b68fc449-9709-4ea1-a365-0075678cd891", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ba54cfd-b283-4e2b-b07e-a4cb404d43be"}]}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:36.107130 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:36.108014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:36.122377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.122943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.124022 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:36.125039 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.125749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.126216 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:36.127460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] validate_networks() for [('4ba54cfd-b283-4e2b-b07e-a4cb404d43be', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:13:36.202865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:36.205741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:36.210322 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-12b2986f-d0c5-408a-a8c9-cc12c55a1d76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1253 microversion: 2.1 time: 0.107088 Aug 30 12:13:36.224461 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 301/617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:36 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1253 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:36.614711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:13:36.615613 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:13:36.616111 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:13:36.616511 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:13:36.617073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:13:36.632396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.633375 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.634427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:36.635158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.635608 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.636182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:36.673270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:13:36.680223 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for user 3733f8f0d14746949cbe92c9d370c33e and project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:13:36.707326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:36.708046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:36.716187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.716775 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.717263 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:36.718582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.719042 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.719471 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:36.750520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:13:36.753019 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b68fc449-9709-4ea1-a365-0075678cd891',volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:13:36.791550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:36.803034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9567c414-533e-4899-b23c-c397c43c7843 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1288 microversion: 2.1 time: 0.099314 Aug 30 12:13:36.803627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 302/618] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:36 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:36.809447 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:36.810839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:36.818955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.819585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.820064 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:36.820791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:36.821252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:36.821680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.006002 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:37.019761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:37.021498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:37.022774 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-59206130-2f14-43ff-bc94-9a1965269c10 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.217423 Aug 30 12:13:37.023439 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 303/619] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:36 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:37.047352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:37.048348 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: 393867e8-3598-4477-a515-e0e91f5ff5df] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:37.055573 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.058547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.058547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.058547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.058547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.058916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.079673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] HTTP exception thrown: Instance 393867e8-3598-4477-a515-e0e91f5ff5df could not be found. Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Request method failure captured: Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df HTTP/1.1 Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2chFL7TTDwBqSSUV8iHuKCFNI9kKGw22-zu3q6bTt-658jo2vyt5oBlVcxKaJsHKfjJjzYa9xyikpmnUk2gSMTEKNjyQmyznycs6wSfrKqi2r_B-Slk13ypWUgPlEVY35EcNk2EtR1HiHVw50oruSpIXKm9bZWchHF3EIyqM_E5_A Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:13:37.081712 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c040647b03574d3a87a335e10d02ef49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 012ead000e8d411eae7034f296455fe7 Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 393867e8-3598-4477-a515-e0e91f5ff5df could not be found. Aug 30 12:13:37.088615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '393867e8-3598-4477-a515-e0e91f5ff5df'} Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393867e8-3598-4477-a515-e0e91f5ff5df could not be found. Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:13:37.089597 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393867e8-3598-4477-a515-e0e91f5ff5df could not be found. Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393867e8-3598-4477-a515-e0e91f5ff5df could not be found. Aug 30 12:13:37.090986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:13:37.092293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Returning 404 to user: Instance 393867e8-3598-4477-a515-e0e91f5ff5df could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:13:37.092293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bd713998-ac96-4ffa-ba94-72e1674ecb4d tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df" status: 404 len: 111 microversion: 2.1 time: 0.059219 Aug 30 12:13:37.092293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 304/620] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:37 2022] GET /compute/v2.1/servers/393867e8-3598-4477-a515-e0e91f5ff5df => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:13:37.097949 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:37.098643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:37.106633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.107364 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.108646 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.109522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.110199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.110774 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.169839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:13:37.221848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6fc28d8d-16c3-4871-9884-6d39b8073db1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.233340 Aug 30 12:13:37.223161 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 317/621] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:13:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:13:37.235874 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dffeaec1-91d0-4e9f-a9c4-54343f1838d6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:37.236863 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dffeaec1-91d0-4e9f-a9c4-54343f1838d6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:37.348460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dffeaec1-91d0-4e9f-a9c4-54343f1838d6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:37.363678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dffeaec1-91d0-4e9f-a9c4-54343f1838d6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1095 microversion: 2.1 time: 0.125569 Aug 30 12:13:37.364424 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 318/622] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:37 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1095 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:37.382793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:37.383594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:37.390406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.391237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.391826 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.393560 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.394198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.394783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.541451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:37.551472 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fa791ec5-83d4-49c1-9f93-b409837f9d19 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 204 len: 0 microversion: 2.1 time: 0.457003 Aug 30 12:13:37.552125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 305/623] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:13:37 2022] DELETE /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:13:37.554523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b4767b22-ab10-4a39-9711-cad64495ab1f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1317 microversion: 2.1 time: 0.177367 Aug 30 12:13:37.561628 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:37.562334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:37.579628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 319/624] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:37 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:37.584011 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.584381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.588420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.588420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.588420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.588420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.773665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:37.783228 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b9464b92-73bf-4494-b095-660cc3b3c5ca tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.226465 Aug 30 12:13:37.784016 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 306/625] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:37 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:37.828513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:37.830080 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:37.836165 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.836639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.838193 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.838193 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:37.838421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:37.838782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:37.918491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:37.927247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9f04ee69-dd81-4cb5-9124-59af070458ed tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1296 microversion: 2.1 time: 0.103638 Aug 30 12:13:37.928394 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 320/626] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:37 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:38.048579 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:38.049796 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:38.056699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.057655 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.058372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.059568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.060304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.060836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.241236 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:38.252062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:38.257562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:38.259062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-45fa4f5f-4c79-4714-af6d-38efb5bb6b2d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.216154 Aug 30 12:13:38.259708 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 307/627] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:38 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:38.390366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:38.392036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:38.399257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.400203 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.400825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.401715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.402392 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.403086 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.430418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:38.483638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:38.493644 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-170d7a18-a26c-4cec-9b19-a3392137b84d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1145 microversion: 2.1 time: 0.110373 Aug 30 12:13:38.494405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 321/628] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:38 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1145 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:38.589348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:38.589769 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:38.607037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.608087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.608756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.609671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.610457 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.611165 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.627827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-36bdaa3f-1995-4ea8-938a-77947bbebb04 req-c8132cfc-7bcc-4716-a4ae-8677377123d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a946d9a-667e-4a85-bd51-7ffee16f8905", "name": "network-vif-plugged", "status": "completed", "tag": "5634a068-6874-4e11-8b3a-39d600ea396c"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:38.638405 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-36bdaa3f-1995-4ea8-938a-77947bbebb04 req-c8132cfc-7bcc-4716-a4ae-8677377123d6 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.638885 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-36bdaa3f-1995-4ea8-938a-77947bbebb04 req-c8132cfc-7bcc-4716-a4ae-8677377123d6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.640132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-36bdaa3f-1995-4ea8-938a-77947bbebb04 req-c8132cfc-7bcc-4716-a4ae-8677377123d6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.652662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-36bdaa3f-1995-4ea8-938a-77947bbebb04 req-c8132cfc-7bcc-4716-a4ae-8677377123d6 service nova] Creating event network-vif-plugged:5634a068-6874-4e11-8b3a-39d600ea396c for instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 on hv-cinder-83976 Aug 30 12:13:38.657886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-36bdaa3f-1995-4ea8-938a-77947bbebb04 req-c8132cfc-7bcc-4716-a4ae-8677377123d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120784 Aug 30 12:13:38.659219 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 308/629] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:38.691352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:38.700974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-027e65e5-9522-46a2-8c4b-6d672a3e9273 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1327 microversion: 2.1 time: 0.117294 Aug 30 12:13:38.702804 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 322/630] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:38 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:38.804670 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:38.805360 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:38.813338 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.814095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.814701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.815389 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.816033 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.816606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.953665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:38.954862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:38.961816 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.962709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.963443 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.964342 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:38.964953 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:38.965566 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:38.971517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:38.980771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-05f3e9bc-e6ab-4190-bb0a-1929e367509b tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.180942 Aug 30 12:13:38.995688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 309/631] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:38 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:39.053756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:39.061862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c933d393-20e5-44e2-9fc3-7d082cb7fcde tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1296 microversion: 2.1 time: 0.113375 Aug 30 12:13:39.063074 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 323/632] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:38 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1296 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:39.282448 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:39.283561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:39.293034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:39.293625 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:39.294156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:39.294952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:39.295586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:39.296041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:39.454054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:39.469878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:39.471318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:39.472586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-66012f95-fdde-445e-bf98-c651a55c5897 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.194164 Aug 30 12:13:39.473331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 310/633] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:39 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:39.516283 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:39.517014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:39.523347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:39.523924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:39.524465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:39.525220 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:39.525742 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:39.526229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:39.629258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:39.637938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fba2dc95-bbfa-4aeb-bfee-7a252610e6af tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1145 microversion: 2.1 time: 0.125720 Aug 30 12:13:39.639978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 324/634] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:39 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:39.729468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:39.730145 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:39.742798 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:39.743330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:39.743908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:39.744674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:39.745135 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:39.749420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:39.840974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:39.856282 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2ea4aba4-01cd-42f3-b651-4746c2e4c6ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1327 microversion: 2.1 time: 0.130738 Aug 30 12:13:39.856282 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 311/635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:39 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:40.004029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:40.010959 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:40.012828 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.013397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.013910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.015544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.016141 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.016649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.084159 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:40.085285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:40.101175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.102968 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.116713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.118195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.118994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.119656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.259323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:40.279665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f22b9cd1-e903-4d57-a94a-1437ac4b865f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1296 microversion: 2.1 time: 0.194228 Aug 30 12:13:40.280696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 312/636] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:40 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1296 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:40.335366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:40.347520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bf93c84b-df20-4d4a-a9d4-df8fb1baa0eb tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1522 microversion: 2.1 time: 0.347652 Aug 30 12:13:40.351794 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 325/637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:39 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:40.507014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:40.508846 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:40.540322 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.548025 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.550768 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.556296 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.556296 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.556296 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.661775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:40.664706 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:40.685713 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.689339 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.691252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.696199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.699461 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.704670 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.918727 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:40.929572 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:40.931216 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:40.932702 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2823ca03-250c-491a-8f50-72f84e9211d1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.435830 Aug 30 12:13:40.933775 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 313/638] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:40 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:40.939884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:40.944035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:40.962333 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.968535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.969883 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:40.973253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:40.974148 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:40.974858 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:41.151373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:41.161795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a4cb4421-7026-4402-96fb-3a8077771d21 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1137 microversion: 2.1 time: 0.504565 Aug 30 12:13:41.162997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 326/639] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:40 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1137 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:41.306934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-bfe9f26a-cd84-4643-8e53-1fed5f20be5b req-2d31bd0d-ae49-4bc5-9c47-3dde15148176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10ec061-4640-4100-bc70-536c1e6f263c", "name": "network-vif-deleted", "tag": "397487c0-c694-4ca4-832b-a518e277191a"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:41.320788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-bfe9f26a-cd84-4643-8e53-1fed5f20be5b req-2d31bd0d-ae49-4bc5-9c47-3dde15148176 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:41.321639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-bfe9f26a-cd84-4643-8e53-1fed5f20be5b req-2d31bd0d-ae49-4bc5-9c47-3dde15148176 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:41.322282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-bfe9f26a-cd84-4643-8e53-1fed5f20be5b req-2d31bd0d-ae49-4bc5-9c47-3dde15148176 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:41.419159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-bfe9f26a-cd84-4643-8e53-1fed5f20be5b req-2d31bd0d-ae49-4bc5-9c47-3dde15148176 service nova] Creating event network-vif-deleted:397487c0-c694-4ca4-832b-a518e277191a for instance f10ec061-4640-4100-bc70-536c1e6f263c on hv-cinder-83976 Aug 30 12:13:41.419797 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:41.430645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-bfe9f26a-cd84-4643-8e53-1fed5f20be5b req-2d31bd0d-ae49-4bc5-9c47-3dde15148176 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230960 Aug 30 12:13:41.434755 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 327/640] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:13:41.444526 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-76d009e4-0b3f-4318-91f5-4afbeff4e56b tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.509540 Aug 30 12:13:41.453734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 314/641] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:40 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:41.454106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:41.455992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:41.473262 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:41.476252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:41.485178 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:41.490930 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:41.491624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:41.492450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:41.492962 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:41.496087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:41.500906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:41.501936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:41.504020 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:41.510256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:41.510256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:41.510256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:41.680156 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:41.694145 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9ff03d2a-6081-4607-9761-1704ee98e9f1 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1306 microversion: 2.1 time: 0.230986 Aug 30 12:13:41.695244 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 315/642] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:41 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1306 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:41.943266 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:41.958374 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f6752442-aa59-46bc-a46b-fe8d8d338aa7 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.516465 Aug 30 12:13:41.958966 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 328/643] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:41 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:41.972116 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:41.972116 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:41.974868 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:41.975546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:41.979613 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:41.989274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:41.989274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:41.989274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.185780 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:42.187475 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:42.205097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:42.205539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:42.205986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.206831 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:42.207477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:42.208148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.480800 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:42.504626 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-24d5a2a8-cc12-4486-b6aa-d7ec84c00073 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1201 microversion: 2.1 time: 0.316937 Aug 30 12:13:42.508823 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 329/644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:42 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1201 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:42.524313 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:42.524964 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:42.536491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:42.541385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:42.554582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:42.556681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:42.557166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.557896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:42.563176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:42.564789 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-28d4c7a6-781f-4bdc-88a3-19bbc163ac89 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.607750 Aug 30 12:13:42.566821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 316/645] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:41 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:42.567592 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:42.568485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.718972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:42.719755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:42.728590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:42.729455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:42.730142 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.731146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:42.731821 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:42.732553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.785579 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:42.786660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:42.787400 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:42.788098 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lazy-loading 'fault' on Instance uuid f10ec061-4640-4100-bc70-536c1e6f263c {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:13:42.851253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012ead000e8d411eae7034f296455fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040647b03574d3a87a335e10d02ef49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:42.854905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:42.860707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-19f4a0f2-14ab-4445-9148-18074353237e tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 200 len: 1311 microversion: 2.1 time: 0.146041 Aug 30 12:13:42.861775 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 317/646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:42 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:42.988904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:42.990665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:43.003847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.007242 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.008376 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.009595 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.010172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.010822 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.622009 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:43.635074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6d0a02dc-e5fc-4d35-a71a-81596a53e0a9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.654052 Aug 30 12:13:43.635685 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 318/647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:42 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:43.657984 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:43.658602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:43.665569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.666417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.667212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.668562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.669225 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.669876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.786054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:43.804654 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-be15c504-211f-4224-a689-d9fd24d5daf6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1211 microversion: 2.1 time: 0.151230 Aug 30 12:13:43.823878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 319/648] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:43 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1211 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:43.832342 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:43.834077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:43.843077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.843927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.845098 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.846063 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.848043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.848720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.906202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:43.919498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-452f6f27-18c3-406f-9b72-714be1bfa380 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 1.408570 Aug 30 12:13:43.943859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 330/649] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:42 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:43.949523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:43.950440 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] [instance: f10ec061-4640-4100-bc70-536c1e6f263c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:43.959118 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.960033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.960739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.961732 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:43.962423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:43.963085 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:43.993201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] HTTP exception thrown: Instance f10ec061-4640-4100-bc70-536c1e6f263c could not be found. Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Request method failure captured: Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c HTTP/1.1 Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2chFL7TTDwBqSSUV8iHuKCFNI9kKGw22-zu3q6bTt-658jo2vyt5oBlVcxKaJsHKfjJjzYa9xyikpmnUk2gSMTEKNjyQmyznycs6wSfrKqi2r_B-Slk13ypWUgPlEVY35EcNk2EtR1HiHVw50oruSpIXKm9bZWchHF3EIyqM_E5_A Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:13:43.995504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c040647b03574d3a87a335e10d02ef49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c040647b03574d3a87a335e10d02ef49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: c040647b03574d3a87a335e10d02ef49 Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-525833633 Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 012ead000e8d411eae7034f296455fe7 Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-ServerRescueNegativeTestJSON-525833633-project Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance f10ec061-4640-4100-bc70-536c1e6f263c could not be found. Aug 30 12:13:43.997725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'f10ec061-4640-4100-bc70-536c1e6f263c'} Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10ec061-4640-4100-bc70-536c1e6f263c could not be found. Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:13:43.998793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10ec061-4640-4100-bc70-536c1e6f263c could not be found. Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10ec061-4640-4100-bc70-536c1e6f263c could not be found. Aug 30 12:13:44.000089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:13:44.005954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] Returning 404 to user: Instance f10ec061-4640-4100-bc70-536c1e6f263c could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:13:44.005954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8739eaed-56ed-403b-b3c5-8aeb0fe0ff75 tempest-ServerRescueNegativeTestJSON-525833633 tempest-ServerRescueNegativeTestJSON-525833633-project] 10.222.0.42 "GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c" status: 404 len: 111 microversion: 2.1 time: 0.056789 Aug 30 12:13:44.005954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 331/650] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:43 2022] GET /compute/v2.1/servers/f10ec061-4640-4100-bc70-536c1e6f263c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:13:44.315380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:44.323548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:44.335865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:44.337975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:44.341304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2308a31e-2f6e-4652-b4d6-f609187d8b1d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.515963 Aug 30 12:13:44.345242 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 320/651] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:43 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:44.704605 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:44.704605 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:44.769854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:44.770430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:44.776593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:44.777382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:44.777904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:44.785752 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:44.833564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:44.836144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:44.840204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=12 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:44.865530 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:44.866895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:44.867590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:44.875395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:44.876633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:44.877604 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:45.230356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:45.235974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:45.253271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7f87f200-2297-4edf-9b79-18f17b4e0862 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1278 microversion: 2.1 time: 0.425448 Aug 30 12:13:45.257504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ffe88963-e032-4530-80f8-133e94a98b87 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.575304 Aug 30 12:13:45.273249 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 332/652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:44 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:45.275865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 321/653] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:44 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1278 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:45.281970 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:45.283503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:45.291459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:45.292399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:45.293343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:45.294307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:45.295421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:45.296139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:45.376877 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:45.382617 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:45.405612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:45.405612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:45.410690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:45.411606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:45.416674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:45.418091 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:45.764744 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:45.776745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:45.779088 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:45.782062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c7df132d-9be7-49e5-b9f1-7d5c4b5298a1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.413697 Aug 30 12:13:45.782938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 322/654] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:45 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:45.825948 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:45.834815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5bd57d37-f8e9-4acc-80e6-e62f8708d7cf tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.559927 Aug 30 12:13:45.835408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 333/655] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:45 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:45.970556 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-fcb0f3a2-eee6-4293-811f-060292354655 req-08a0ca48-3437-4ced-9d8d-1d52598b9ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b", "tag": "f90bc006-c400-441e-8ad0-da8e74217fdf"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:45.984015 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fcb0f3a2-eee6-4293-811f-060292354655 req-08a0ca48-3437-4ced-9d8d-1d52598b9ebd service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:45.984766 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fcb0f3a2-eee6-4293-811f-060292354655 req-08a0ca48-3437-4ced-9d8d-1d52598b9ebd service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:45.985407 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-fcb0f3a2-eee6-4293-811f-060292354655 req-08a0ca48-3437-4ced-9d8d-1d52598b9ebd service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.049428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-fcb0f3a2-eee6-4293-811f-060292354655 req-08a0ca48-3437-4ced-9d8d-1d52598b9ebd service nova] Creating event network-changed:f90bc006-c400-441e-8ad0-da8e74217fdf for instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b on hv-cinder-83976 Aug 30 12:13:46.074783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-fcb0f3a2-eee6-4293-811f-060292354655 req-08a0ca48-3437-4ced-9d8d-1d52598b9ebd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107566 Aug 30 12:13:46.081047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 323/656] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:46.282166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:46.284145 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:46.301855 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:46.302934 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:46.312088 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.318139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.318989 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.319676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.321387 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.322075 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.322949 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.323671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.325474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.326898 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.333396 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.334085 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.664234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=4 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:46.836533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:46.861088 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fbacf6d9-0583-43c0-8ad0-e5e5abf73a9e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.582171 Aug 30 12:13:46.879051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 334/657] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:46 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:46.885958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:46.899531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:46.902677 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:46.903738 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4dce2e55-d386-4f4e-aec6-5fe94236274e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.603208 Aug 30 12:13:46.904687 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 324/658] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:46 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:46.921283 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.922068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.924029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.924210 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:46.924334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.924449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:46.926177 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.927294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.946204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.947099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.948779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:46.957088 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:46.957820 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:46.958450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:47.321929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:47.334986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3fdeac00-a492-45e6-89c1-c17d7d5fe3a9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.424622 Aug 30 12:13:47.344659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 325/659] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:46 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:47.344659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-6e7dd896-725b-4c1f-a1c3-70ce4feee05e req-a659e5c2-6522-4925-a511-27cf527f8e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07", "tag": "434c6abc-e73a-47b5-8fda-e567642152ab"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:47.356629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=24 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:47.365488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6e7dd896-725b-4c1f-a1c3-70ce4feee05e req-a659e5c2-6522-4925-a511-27cf527f8e53 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:47.366261 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6e7dd896-725b-4c1f-a1c3-70ce4feee05e req-a659e5c2-6522-4925-a511-27cf527f8e53 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:47.366861 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6e7dd896-725b-4c1f-a1c3-70ce4feee05e req-a659e5c2-6522-4925-a511-27cf527f8e53 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:47.393549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-6e7dd896-725b-4c1f-a1c3-70ce4feee05e req-a659e5c2-6522-4925-a511-27cf527f8e53 service nova] Creating event network-changed:434c6abc-e73a-47b5-8fda-e567642152ab for instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 on hv-cinder-83976 Aug 30 12:13:47.403633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-6e7dd896-725b-4c1f-a1c3-70ce4feee05e req-a659e5c2-6522-4925-a511-27cf527f8e53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066662 Aug 30 12:13:47.404637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 326/660] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:47.710352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:47.720485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:47.728047 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:47.736249 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-332ff2bb-7d15-47b6-bd17-4da82c3dff86 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.855853 Aug 30 12:13:47.737890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 335/661] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:46 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:47.886484 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:47.887197 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:47.898021 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:47.900485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:47.900937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:47.901677 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:47.902160 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:47.902582 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:47.928096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:47.928865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:47.944803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:47.946038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:47.946998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:47.948146 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:47.952661 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:47.953353 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:48.502923 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:48.512256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d4486697-4bdf-4fc0-b974-c13080a3dfd6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.630150 Aug 30 12:13:48.525514 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 327/662] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:47 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:48.541286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-c767bf16-fd0c-4ea2-97d7-dd97be86e0a4 req-b23138be-4dac-43d2-9138-1fc0e939b9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d3c7d0-1615-465b-9099-7ebed6b4f402", "tag": "c119f48c-5cdc-4730-83b4-4520b61dc812"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:48.583940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-c767bf16-fd0c-4ea2-97d7-dd97be86e0a4 req-b23138be-4dac-43d2-9138-1fc0e939b9d2 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:48.590419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-c767bf16-fd0c-4ea2-97d7-dd97be86e0a4 req-b23138be-4dac-43d2-9138-1fc0e939b9d2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:48.593026 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-c767bf16-fd0c-4ea2-97d7-dd97be86e0a4 req-b23138be-4dac-43d2-9138-1fc0e939b9d2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:48.634319 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-c767bf16-fd0c-4ea2-97d7-dd97be86e0a4 req-b23138be-4dac-43d2-9138-1fc0e939b9d2 service nova] Creating event network-changed:c119f48c-5cdc-4730-83b4-4520b61dc812 for instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 on hv-cinder-83976 Aug 30 12:13:48.649794 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-c767bf16-fd0c-4ea2-97d7-dd97be86e0a4 req-b23138be-4dac-43d2-9138-1fc0e939b9d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120101 Aug 30 12:13:48.652332 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 328/663] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:13:48.663392 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:48.665416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:48.683218 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:48.689490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:48.691809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:48.693700 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:48.696770 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:48.697748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:48.943619 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:48.960604 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-22a79ef0-d97c-48ed-9533-3b07fb7ee512 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.306422 Aug 30 12:13:48.961189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 329/664] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:48 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:48.967128 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:48.967998 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:48.989965 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:48.990466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:48.990979 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:48.991739 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:48.992107 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:48.992535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:49.210242 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:49.238435 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-12a19917-b5c0-41f7-9bcc-0c0b8ed77ae7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 1.313987 Aug 30 12:13:49.239073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 336/665] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:47 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:49.299101 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:49.308901 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:49.313092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:49.314434 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a4cd2f49-bdbc-49f4-aca1-f6d59cd8bdf0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.352018 Aug 30 12:13:49.314999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 330/666] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:48 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:49.548589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:49.556270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:49.556270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:49.557645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:49.557645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:49.558654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:49.559209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:49.560203 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:49.983324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:49.984785 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:49.995284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:50.007171 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:50.007924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:50.008903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:50.009539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:50.010180 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:50.013870 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:50.042301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c8b2e3f4-fd48-4a2f-894e-b2274b361ec9 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.499358 Aug 30 12:13:50.045139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 337/667] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:49 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:50.260107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:50.261409 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:50.277798 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:50.279580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:50.281100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:50.288966 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:50.289687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:50.290339 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:50.336882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:50.347167 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0ad9d861-586e-4caf-b670-9d4d56232cd1 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.367955 Aug 30 12:13:50.360200 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 331/668] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:49 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:50.367671 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:50.368384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:50.387411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:50.390519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:50.390519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:50.390519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:50.390519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:50.390895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:50.734164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:50.744951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e6eadf83-c02b-46f3-8a8c-1138d9fcb805 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.488898 Aug 30 12:13:50.748860 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 338/669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:50 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:50.812527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:50.824765 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:50.826308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:50.828119 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ddd1721c-b6ae-4639-a730-a4ca8d7b6532 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.471758 Aug 30 12:13:50.828909 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 332/670] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:50 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:51.069366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:51.074397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:51.095464 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.096048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.097379 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:51.098428 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.103674 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.112872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:51.122589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:51.325694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:51.337070 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a8ae622e-1bcc-4e27-af41-4d4af840de90 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.272770 Aug 30 12:13:51.338662 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 339/671] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:51 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:51.375612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:51.383195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:51.400796 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.401260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.401714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:51.403182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.403865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.404303 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:51.751827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:51.765542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-af1f04d0-7049-41b0-a7cd-cccc19ac36b9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.398544 Aug 30 12:13:51.767212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 333/672] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:51 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:51.792246 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:51.793025 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:51.801695 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.802256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.802784 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:51.803580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.804160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.804660 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:51.870827 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:51.874929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:51.892904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.893819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.894486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:51.895381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:51.896017 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:51.896590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:52.013719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:52.036072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-75b92be4-5a8f-49b0-9ed9-57a41d58253c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.248215 Aug 30 12:13:52.040556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 340/673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:51 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:52.175015 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:52.193732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:52.195491 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:52.196734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a20fac5b-dc52-4526-a78e-7c404e952a4f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.347464 Aug 30 12:13:52.199288 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 334/674] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:51 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:52.362175 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:52.363877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:52.380801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:52.381709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:52.383622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:52.384622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:52.393646 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:52.394035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:52.609645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:52.625101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e24c2d23-1783-4a10-9958-5d2a1ce64d7e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.265838 Aug 30 12:13:52.628095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 341/675] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:52 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:52.800546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:52.801798 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:52.810292 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:52.810795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:52.813158 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:52.813158 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:52.813607 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:52.814043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:53.053804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:53.069117 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:53.069742 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:53.076008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:53.076749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:53.077649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:53.078715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:53.078869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e885d584-c712-4421-841e-a3934eae152a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.287040 Aug 30 12:13:53.085198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:53.086205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:53.097957 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 335/676] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:52 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:13:53.224183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:53.224183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:53.244614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:53.245335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:53.245946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:53.246825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:53.262144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:53.263250 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:53.293553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:53.494059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:53.508349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:53.525094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:53.528027 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-22572c79-3a2d-4ab3-b7eb-d2ce5f44f5e7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.462152 Aug 30 12:13:53.530933 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 342/677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:53 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:53.533912 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:53.537927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fafbab3d-cc31-4c81-9c31-d6a89c48ce3b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.320873 Aug 30 12:13:53.549100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 336/678] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:53 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:53.678714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:53.679458 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:53.704896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:53.706428 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:53.708335 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:53.709258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:53.709915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:53.710511 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:54.021645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:54.037376 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7c559cde-a023-4877-aae4-d85e92f2cb20 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.376511 Aug 30 12:13:54.041134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 343/679] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:53 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:54.106482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:54.107603 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:54.118305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:54.129670 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:54.134300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:54.134300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:54.134300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:54.134300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:54.290097 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:54.298690 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-77b7aad2-3a9e-4858-a03c-965c773b8d34 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.196775 Aug 30 12:13:54.299589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 337/680] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:54 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:54.570877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:54.570877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:54.570877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:54.570877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:54.572134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:54.572134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:54.572134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:54.572134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:54.572608 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:54.573755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:54.587247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:54.588052 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:54.592814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:54.593824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:54.594410 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:54.594970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:54.786282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:54.794372 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-da2f2d8e-26fe-45a8-bfc2-641cab24dfa1 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.248403 Aug 30 12:13:54.797093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 344/681] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:54 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:54.841211 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:54.850151 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:54.851854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:54.853058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bdbc791e-4898-4fc6-9c5a-5c5b4bb52115 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1738 microversion: 2.20 time: 0.285865 Aug 30 12:13:54.853617 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 338/682] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:54 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:13:55.065134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:55.065746 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:55.072149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.072578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.073014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:55.073716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.074171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.074594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:55.211681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:55.224482 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f06b8f6f-75c8-45c2-af5b-ed3d417293ef tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.163317 Aug 30 12:13:55.225085 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 345/683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:55 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:55.322780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:55.323403 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:55.328032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:55.331977 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.332541 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.332969 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:55.333658 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.334107 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.334525 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:55.475225 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:55.483611 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-794c6bda-5348-4a85-b8b5-80ced285c48d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.164860 Aug 30 12:13:55.484219 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 339/684] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:55 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:55.815372 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:55.816009 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:55.822499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.822977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.823410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:55.824153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.824604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.825042 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:55.876754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:55.877382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:55.883754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.884264 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.884700 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:55.885443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:55.886105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:55.886526 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:56.017143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:56.024819 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-68512e7b-a800-4c91-8209-63f6071b3fb6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.214032 Aug 30 12:13:56.025486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 346/685] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:55 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:56.051542 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:56.063823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:56.065392 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:56.066772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-49dbd20c-00ff-4252-816e-b9434fcd47e3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1720 microversion: 2.20 time: 0.194605 Aug 30 12:13:56.067940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 340/686] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:55 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:56.245467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:56.246082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:56.253152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:56.253646 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:56.254085 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:56.254792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:56.255249 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:56.257307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:56.387741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:56.395628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-757c8354-4721-4cde-b952-7e4ba444a894 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.153876 Aug 30 12:13:56.396151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 347/687] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:56 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:56.503933 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:56.504609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:56.510997 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:56.511474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:56.511907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:56.512611 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:56.513059 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:56.513476 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:56.647630 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:56.655665 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-620810a6-0e58-4820-86c5-588052ad39e3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.155254 Aug 30 12:13:56.656627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 341/688] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:56 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:57.045324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:57.046006 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:57.049452 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:13:57.053195 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.053678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.054110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.054796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.055249 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.055668 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.091064 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:57.091739 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:57.098921 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.099411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.100096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.100982 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.101445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.102137 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.199577 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:57.208636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bd76b5f0-ccb0-401f-8212-af79344fa415 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.167176 Aug 30 12:13:57.210087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 348/689] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:57 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:57.282265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:57.290950 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:57.292523 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:57.293752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-01d211b9-7416-4b67-8318-f9d379b63193 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1720 microversion: 2.20 time: 0.206959 Aug 30 12:13:57.294539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 342/690] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:57 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:57.416537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:57.417249 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:57.424725 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.425224 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.425654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.426357 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.426816 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.427244 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.561920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:57.569554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cf9ccead-8862-4fe3-8cfa-b08a7891b42b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.156922 Aug 30 12:13:57.570129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 349/691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:57 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:57.679677 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:57.680328 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:57.687222 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.687709 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.688172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.688863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:57.689416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:57.689841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:57.870312 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:57.879162 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-63d26b7c-1e8d-413e-b86c-59d1cc95b7ea tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.203318 Aug 30 12:13:57.879752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 343/692] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:57 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:58.230470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:58.231171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:58.242609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.242609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.242609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.242609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.243021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.243021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.321896 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:58.323078 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:58.331854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.332380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.332837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.333544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.333994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.334483 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.464393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:58.477035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cc735416-483f-461c-b410-4bf85cffa10c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.250319 Aug 30 12:13:58.477982 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 350/693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:58 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:58.518545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:58.529740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:58.531700 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:58.533214 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bdd832ac-a172-41ed-933c-98815581b721 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1720 microversion: 2.20 time: 0.219195 Aug 30 12:13:58.548166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 344/694] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:58 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:58.591326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:58.592213 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:58.599099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.599874 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.600681 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.601582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.602525 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.603041 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.755340 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-d2735e51-486d-47a0-942b-08cbda14bc41 req-26b792d9-7544-43fb-b90a-aee8fc377002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a946d9a-667e-4a85-bd51-7ffee16f8905", "name": "network-vif-unplugged", "status": "completed", "tag": "5634a068-6874-4e11-8b3a-39d600ea396c"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:13:58.761202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:58.769780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-d2735e51-486d-47a0-942b-08cbda14bc41 req-26b792d9-7544-43fb-b90a-aee8fc377002 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.770554 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-d2735e51-486d-47a0-942b-08cbda14bc41 req-26b792d9-7544-43fb-b90a-aee8fc377002 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.770676 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-d2735e51-486d-47a0-942b-08cbda14bc41 req-26b792d9-7544-43fb-b90a-aee8fc377002 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.778694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2682569f-5a2e-43cf-9100-03a23642eb3b tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.191845 Aug 30 12:13:58.792039 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-d2735e51-486d-47a0-942b-08cbda14bc41 req-26b792d9-7544-43fb-b90a-aee8fc377002 service nova] Creating event network-vif-unplugged:5634a068-6874-4e11-8b3a-39d600ea396c for instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 on hv-cinder-83976 Aug 30 12:13:58.797866 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 351/695] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:58 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:58.800074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-d2735e51-486d-47a0-942b-08cbda14bc41 req-26b792d9-7544-43fb-b90a-aee8fc377002 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048638 Aug 30 12:13:58.801507 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 345/696] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:13:58.964729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:58.965556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:58.972136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.972975 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.973601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:58.974308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:58.974759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:58.975410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:59.133071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:59.143119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c2334040-ee00-4e96-af05-ed1e35ce1a35 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.182631 Aug 30 12:13:59.144609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 352/697] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:58 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:59.500169 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:59.501182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:59.507758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:59.508384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:59.508820 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:59.509519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:59.509974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:59.510398 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:59.563991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:59.565250 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:59.571601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:59.572358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:59.572546 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:59.578977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:59.582172 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:59.582172 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:59.781708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:59.791529 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:59.794178 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:59.795364 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4e73feee-88db-4289-8414-207986d25a11 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1720 microversion: 2.20 time: 0.242018 Aug 30 12:13:59.807575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 353/698] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:13:59 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:13:59.813852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:13:59.814761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:13:59.824646 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:59.826586 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:59.827933 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:59.828691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:13:59.829298 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:13:59.830123 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:13:59.835014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:59.843451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-55ec6af9-5875-4202-a46c-9f12ae354ddb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.348269 Aug 30 12:13:59.845429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 346/699] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:59 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:13:59.965763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:13:59.977106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e74a8bb9-fb3b-47ec-9450-525c8367a804 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.167650 Aug 30 12:13:59.981380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 354/700] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:13:59 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:00.165018 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:00.166014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:00.173441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:00.185916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:00.185916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:00.185916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:00.185916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:00.186643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:00.421151 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:00.429819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2b33d28d-5ecd-4166-8f4c-d90da98bcca9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.268578 Aug 30 12:14:00.430405 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 347/701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:00 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:00.822629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:00.823977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:00.845462 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:00.846012 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:00.846521 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:00.847322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:00.848190 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:00.848872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:00.877847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:00.879067 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:00.889112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:00.893390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:00.897114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:00.897114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:00.897114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:00.897114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:01.055690 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:01.070966 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:01.074264 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:01.075892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:01.077125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-36552d66-5f29-43c6-baa1-c606911f0df5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1723 microversion: 2.20 time: 0.258344 Aug 30 12:14:01.077998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 355/702] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:00 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:01.083180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:01.084111 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:01.091069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:01.092155 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:01.093149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:01.094335 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:01.095180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:01.095687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:01.214621 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:01.234835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-115c39f5-1430-4b50-8e4c-5dc0f86f1677 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.351433 Aug 30 12:14:01.235454 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 348/703] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:00 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:01.248370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a5d2d5f-e064-40c1-85be-4259cd53d89e"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:01.252751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:01.261121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:01.262685 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:01.263602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:01.265140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:01.266474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:01.267125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:01.272921 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:01.282953 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e94a4181-21bf-4e01-8022-b5ce3c700650 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.203510 Aug 30 12:14:01.294485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 356/704] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:01 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:01.453423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:01.454130 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:01.475728 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:01.476353 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:01.477459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:01.478104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:01.478560 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:01.480496 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:01.694042 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:01.705033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4a1d5f22-e180-47f3-9c63-720d30047835 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.256574 Aug 30 12:14:01.706000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 357/705] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:01 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:02.253064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:02.253683 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:02.259819 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.260415 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.260860 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.261568 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.262030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.262455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.406134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:02.413899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a18e2ea4-55d0-41c7-834a-765347aebc68 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.164893 Aug 30 12:14:02.414573 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 358/706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:02 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:02.422096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:02.423694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:02.438997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.439774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.440308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.441253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.441940 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.442698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.449751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-66e4c4a8-cd9d-4b6b-8235-3897a732badd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.212144 Aug 30 12:14:02.457136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 349/707] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Aug 30 12:14:01 2022] POST /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-volume_attachments => generated 188 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 12:14:02.618058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:02.618568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:02.625337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:02.626492 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.627244 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.627884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.628826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.629592 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.630237 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.637474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-78960f8e-8e55-4c36-a8f2-bfbc2873b056 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.221144 Aug 30 12:14:02.638355 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 359/708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:02 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:02.727854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:02.728640 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:02.737864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:02.740905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.744385 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.745014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.745766 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:02.747495 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:02.748012 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:02.906593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:02.914891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-16840c91-0eb6-4398-9447-b2b58d3d907f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.191959 Aug 30 12:14:02.928699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 360/709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:02 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:03.083037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3dd818bf-57af-49d7-a1a3-48bc33fd65b6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: .version_select at 0x7efe4eddc1f0>, body: {"keypair": {"name": "tempest-keypair-1324069707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL31Wi0ieEtwkh+vqEnKT1PUVEx+8lQ/OxGgULDFDBMxCU9w4Jhp3wGXQp58TU6fJd3LZDmftKtfQK9W7QCVFROjjS/rJe+q43CPhkeFyNsvkZIgEP4ypeRU8+k52SGp9A=="}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:03.098252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-3dd818bf-57af-49d7-a1a3-48bc33fd65b6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:14:03.102649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-3dd818bf-57af-49d7-a1a3-48bc33fd65b6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:14:03.181197 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3dd818bf-57af-49d7-a1a3-48bc33fd65b6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225872 Aug 30 12:14:03.181916 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 361/710] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:14:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:14:03.285771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-75ba5909-9247-45f8-b4c3-6dde27edb4a5 req-800b9f89-e6c0-409a-82e9-824a0a4fd362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b", "name": "network-vif-plugged", "status": "completed", "tag": "f90bc006-c400-441e-8ad0-da8e74217fdf"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:03.302396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-75ba5909-9247-45f8-b4c3-6dde27edb4a5 req-800b9f89-e6c0-409a-82e9-824a0a4fd362 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.302396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-75ba5909-9247-45f8-b4c3-6dde27edb4a5 req-800b9f89-e6c0-409a-82e9-824a0a4fd362 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.302396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-75ba5909-9247-45f8-b4c3-6dde27edb4a5 req-800b9f89-e6c0-409a-82e9-824a0a4fd362 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.313129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-75ba5909-9247-45f8-b4c3-6dde27edb4a5 req-800b9f89-e6c0-409a-82e9-824a0a4fd362 service nova] Creating event network-vif-plugged:f90bc006-c400-441e-8ad0-da8e74217fdf for instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b on hv-cinder-83976 Aug 30 12:14:03.318547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-75ba5909-9247-45f8-b4c3-6dde27edb4a5 req-800b9f89-e6c0-409a-82e9-824a0a4fd362 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039643 Aug 30 12:14:03.319153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 362/711] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:14:03.328252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dd647bf3-b405-4592-a98c-aa8c8aa0abbd tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-volume_attachments/1a5d2d5f-e064-40c1-85be-4259cd53d89e" status: 202 len: 0 microversion: 2.20 time: 0.713986 Aug 30 12:14:03.331300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 350/712] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Aug 30 12:14:02 2022] DELETE /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-volume_attachments/1a5d2d5f-e064-40c1-85be-4259cd53d89e => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:14:03.411534 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:03.412238 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:03.418924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.419689 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.420311 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.421889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.422782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.423238 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.434458 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:03.435640 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:03.451768 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.454055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.454568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.455355 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.455888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.456408 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.490021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121191) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 12:14:03.678415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:03.687686 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5664108e-ed2d-480e-bc8d-a6aaa4d17af6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.256917 Aug 30 12:14:03.688937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 351/713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:03 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:03.697337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:03.698292 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:03.708337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.709030 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.710314 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.711139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.711609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.712058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.863728 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:03.872769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ab39321f-81f8-4b8e-b779-4a6291e96dae tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.182522 Aug 30 12:14:03.873704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 352/714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:03 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:03.883390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9334d842-8bfd-47a7-8d87-9b85c56b7a2f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "POST /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/action" status: 202 len: 0 microversion: 2.20 time: 0.475709 Aug 30 12:14:03.884326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 363/715] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Aug 30 12:14:03 2022] POST /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:14:03.898321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:03.899401 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:03.907498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.908094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.908513 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.909280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.910043 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.910861 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.938563 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:03.939350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:03.946017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.946504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.947126 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:03.948066 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:03.948480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:03.949221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:04.169975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:04.189240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:04.189240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:04.189240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f3a42e89-3484-4e3f-b95b-e55b33c67139 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1671 microversion: 2.20 time: 0.294636 Aug 30 12:14:04.189576 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 353/716] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:03 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1671 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:04.250687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:04.261645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-de8cd197-b57e-4c51-8581-6f57fcbe07c8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.328669 Aug 30 12:14:04.274250 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 364/717] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:03 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:04.708613 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:04.709301 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:04.715433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:04.715925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:04.716390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:04.717300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:04.718379 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:04.718910 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:04.900307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:04.900921 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:04.924344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:04.924344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:04.924344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:04.924344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:04.924812 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:04.924812 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:04.935930 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:04.950273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a041d20b-2a99-4971-a5f5-facfd4438e96 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.245510 Aug 30 12:14:04.950856 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 354/718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:04 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:05.129515 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:05.137905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f02a7b8c-5db7-4c60-9859-b9c088283e76 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1362 microversion: 2.1 time: 0.242990 Aug 30 12:14:05.138495 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 365/719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:04 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:05.212118 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:05.213083 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:05.219370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:05.219937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:05.220609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:05.221314 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:05.221774 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:05.222198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:05.285441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:05.286310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:05.297411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:05.298145 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:05.302556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:05.302556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:05.302556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:05.302556 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:05.403468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:05.413739 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:05.415591 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:05.417001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-21397e63-0020-43a7-88ab-2539e2d4479e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1671 microversion: 2.20 time: 0.209121 Aug 30 12:14:05.434473 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 355/720] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:05 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:05.440708 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-68f89ff9-9cdc-4bf8-8724-ca1b8a219624 req-09741ba8-00ce-4291-afe8-57a1642f09a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07", "name": "network-vif-plugged", "status": "completed", "tag": "434c6abc-e73a-47b5-8fda-e567642152ab"}, {"server_uuid": "56d3c7d0-1615-465b-9099-7ebed6b4f402", "name": "network-vif-plugged", "status": "completed", "tag": "c119f48c-5cdc-4730-83b4-4520b61dc812"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:05.454475 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-68f89ff9-9cdc-4bf8-8724-ca1b8a219624 req-09741ba8-00ce-4291-afe8-57a1642f09a7 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:05.455420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-68f89ff9-9cdc-4bf8-8724-ca1b8a219624 req-09741ba8-00ce-4291-afe8-57a1642f09a7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:05.456165 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-68f89ff9-9cdc-4bf8-8724-ca1b8a219624 req-09741ba8-00ce-4291-afe8-57a1642f09a7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:05.470862 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-68f89ff9-9cdc-4bf8-8724-ca1b8a219624 req-09741ba8-00ce-4291-afe8-57a1642f09a7 service nova] Creating event network-vif-plugged:434c6abc-e73a-47b5-8fda-e567642152ab for instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 on hv-cinder-83976 Aug 30 12:14:05.472428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-68f89ff9-9cdc-4bf8-8724-ca1b8a219624 req-09741ba8-00ce-4291-afe8-57a1642f09a7 service nova] Creating event network-vif-plugged:c119f48c-5cdc-4730-83b4-4520b61dc812 for instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 on hv-cinder-83976 Aug 30 12:14:05.479637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-68f89ff9-9cdc-4bf8-8724-ca1b8a219624 req-09741ba8-00ce-4291-afe8-57a1642f09a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043135 Aug 30 12:14:05.480371 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 356/721] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:05.496362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:05.507094 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0c55d4f7-549e-420a-be07-b630a4986672 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.227439 Aug 30 12:14:05.507685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 366/722] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:05 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:05.976756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:05.996036 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:06.008699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.009606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.010207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.011132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.011765 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.012387 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.132679 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-228334815", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5440e9-8593-4ddc-a45f-ad471b8efbac"}], "security_groups": [{"name": "tempest-securitygroup--671657788"}], "key_name": "tempest-keypair-1324069707", "user_data": "}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:06.271056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] validate_networks() for [('4d5440e9-8593-4ddc-a45f-ad471b8efbac', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:14:06.278133 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:06.285573 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3f2fc1c4-87dc-4d62-8df2-ac26c9a366fb tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.317450 Aug 30 12:14:06.286421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 357/723] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:05 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:06.291482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:06.302627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:06.305534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.306096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.306794 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.307695 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.308384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.308924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.457388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:06.467022 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e5845868-9dd9-46a0-a1c6-560293f82479 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1548 microversion: 2.1 time: 0.179211 Aug 30 12:14:06.468375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 358/724] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:06 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:06.480121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:06.480876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:06.488045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.488624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.489288 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.489970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.490455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.490879 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.639751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:06.648184 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:06.649636 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:06.650995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1cfde41f-116f-4e5d-88bd-2b47e7c9d300 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.177022 Aug 30 12:14:06.651558 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 359/725] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:06 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:06.662207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:06.662704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:06.671406 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.671898 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.672413 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.673119 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.673578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.674143 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.700813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:14:06.701237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:14:06.702143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:14:06.702567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:14:06.702983 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:14:06.713059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.716296 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.716746 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.717520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.718029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.718453 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.741602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:14:06.746469 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:14:06.761059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:14:06.762288 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:14:06.762490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dd5eb5ba-4d37-48a3-a04c-e453d37971d1 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109621 Aug 30 12:14:06.763363 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 360/726] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:14:06 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:06.768008 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:06.768707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:06.775642 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.776760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.776889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.777693 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:06.778213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:06.778699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:06.892241 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-09b6989d-81aa-45ab-9ad7-0fb89da0b714 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.764245 Aug 30 12:14:06.899931 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 367/727] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:14:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:14:06.913017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-79796f2a-30d6-46e4-b704-363bea58a74a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:06.914389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-79796f2a-30d6-46e4-b704-363bea58a74a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:06.936412 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:06.946269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ef7d30e1-dfe4-4464-87d9-90616abd7b6a tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.181961 Aug 30 12:14:06.950529 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 361/728] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:06 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:07.015301 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-79796f2a-30d6-46e4-b704-363bea58a74a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:07.029017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-79796f2a-30d6-46e4-b704-363bea58a74a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1241 microversion: 2.1 time: 0.116276 Aug 30 12:14:07.029749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 368/729] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:06 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:07.309481 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:07.311499 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:07.322068 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:07.322902 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:07.323806 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:07.325948 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:07.325948 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:07.326468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:07.491414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:07.503132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bf8b65ef-a6ac-4f02-b7e5-381580825a28 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1266 microversion: 2.1 time: 0.199788 Aug 30 12:14:07.504308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 362/730] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:07 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:07.678212 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:07.678848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:07.692014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:07.694979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:07.694979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:07.694979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:07.700367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:07.701120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:07.928619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:07.941110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:07.942750 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:07.950139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-92f51855-b395-4887-9fa1-9233be1ad48a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.278596 Aug 30 12:14:07.951363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 369/731] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:07 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:07.978791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:07.984283 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:07.997924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:07.998418 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:07.998924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:07.999823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.000304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.000725 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:08.062179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2068a327-3937-4854-b1bc-4e882f0efae7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:08.063255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2068a327-3937-4854-b1bc-4e882f0efae7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:08.214830 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:08.224302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-17ff067c-5427-4241-9bf4-dc49e887a0b2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1357 microversion: 2.1 time: 0.259143 Aug 30 12:14:08.225753 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 363/732] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:07 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:08.496839 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2068a327-3937-4854-b1bc-4e882f0efae7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:08.504230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-4a423b10-69c5-43b9-95e4-f450d03123bb req-1e8a27ba-64ed-4ab5-913c-84272fad9e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b", "tag": "f90bc006-c400-441e-8ad0-da8e74217fdf"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:08.504992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2068a327-3937-4854-b1bc-4e882f0efae7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1241 microversion: 2.1 time: 0.458067 Aug 30 12:14:08.505953 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 370/733] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:08 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1241 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:08.515406 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-4a423b10-69c5-43b9-95e4-f450d03123bb req-1e8a27ba-64ed-4ab5-913c-84272fad9e1b service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.516140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-4a423b10-69c5-43b9-95e4-f450d03123bb req-1e8a27ba-64ed-4ab5-913c-84272fad9e1b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.519139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-4a423b10-69c5-43b9-95e4-f450d03123bb req-1e8a27ba-64ed-4ab5-913c-84272fad9e1b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:08.528882 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:08.529284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-4a423b10-69c5-43b9-95e4-f450d03123bb req-1e8a27ba-64ed-4ab5-913c-84272fad9e1b service nova] Creating event network-changed:f90bc006-c400-441e-8ad0-da8e74217fdf for instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b on hv-cinder-83976 Aug 30 12:14:08.529722 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:08.535776 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-4a423b10-69c5-43b9-95e4-f450d03123bb req-1e8a27ba-64ed-4ab5-913c-84272fad9e1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035881 Aug 30 12:14:08.536660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 364/734] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:14:08.537104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.537893 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.539241 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:08.540202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.540870 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.541471 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:08.692589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:08.700966 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3d38b9bc-1da6-4891-be86-8b3fa66b06e9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1453 microversion: 2.1 time: 0.176647 Aug 30 12:14:08.701542 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 371/735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:08 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:08.722851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:08.723568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:08.730198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.730679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.731165 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:08.731847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.732331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.732753 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:08.906910 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:08.916042 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ea8abe3d-accc-4f1c-a88d-fa640f6eec05 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1453 microversion: 2.1 time: 0.197663 Aug 30 12:14:08.918257 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 365/736] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:08 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:08.978654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:08.980015 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:08.987340 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.988722 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.989405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:08.990321 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:08.990957 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:08.991771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.246856 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:09.247469 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:09.254205 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.254963 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.255395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.256123 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.256735 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.257490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.429441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:09.443791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:09.446972 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:09.448698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3efe8206-4a9a-4f7b-a4b0-a96a2237581b tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.475586 Aug 30 12:14:09.467768 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 372/737] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:08 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:09.530612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:09.531935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:09.540208 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.540965 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.541583 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.542465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.543434 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.544134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.609386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:09.630090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a860a60f-6972-4e48-b810-52f13e8f0f0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1547 microversion: 2.1 time: 0.386785 Aug 30 12:14:09.631126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 366/738] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:09 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1547 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:09.654924 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:09.655779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:09.663823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.664414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.665056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.666535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.667344 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.668013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.675849 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:09.681473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:09.697961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-467f76f0-c006-445f-b0c4-87ec5478aa22 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1293 microversion: 2.1 time: 0.168805 Aug 30 12:14:09.707822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 373/739] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:09 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:09.851918 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:09.861054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-53043776-fac1-4e46-8741-52d3b8e6a810 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1547 microversion: 2.1 time: 0.213145 Aug 30 12:14:09.861807 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 367/740] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:09 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1547 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:09.881132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:09.887001 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:09.887770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Searching by: {'deleted': False, 'project_id': '66ad307771aa4815a2c5d81606f60ba8'} {{(pid=121191) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 12:14:09.895438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.895926 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.896602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.897336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:09.898104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:09.898540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:09.996485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.multi_cell_list [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121191) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 12:14:10.107307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-add5947a-b2b1-4e32-883e-c96677709b0d tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229867 Aug 30 12:14:10.108220 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 374/741] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Aug 30 12:14:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:10.128694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:10.130121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:10.137018 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:10.137517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:10.137937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:10.138629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:10.139078 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:10.139811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:10.279073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:10.287733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1836b831-c2eb-4d1b-99c8-c4af346f53f9 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1547 microversion: 2.1 time: 0.166476 Aug 30 12:14:10.288336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 368/742] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:10 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:10.477694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:10.478540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:10.486488 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:10.487363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:10.488499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:10.489374 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:10.490272 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:10.491015 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:10.516763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:10.733637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:10.735309 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:10.746474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:10.747076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:10.747587 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:10.748390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:10.748917 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:10.750910 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:10.826202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:10.834594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:10.836398 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:10.837729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-87d5c696-c1c7-4ff4-ae53-bc30ad5b77b7 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.366033 Aug 30 12:14:10.840432 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 375/743] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:10 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:10.851064 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:10.860381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-11adc3e8-2c0a-4502-a23f-4ace877fe552 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1311 microversion: 2.1 time: 0.131399 Aug 30 12:14:10.860960 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 369/744] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:10 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1311 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:11.861325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:11.863159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:11.871643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:11.876739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:11.876739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:11.876739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:11.876739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:11.877105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:11.882085 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:11.882700 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:11.898718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:11.900989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:11.903761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:11.903761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:11.903761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:11.903761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:12.215197 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:12.229282 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c090db7f-1d29-43c6-b278-886b81d23eb8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.350159 Aug 30 12:14:12.232110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 370/745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:11 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:12.428175 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:12.439739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:12.441840 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:12.443658 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-549b1e02-24a4-413d-9d48-b1b728f28a75 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.586343 Aug 30 12:14:12.444712 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 376/746] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:11 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:14:12.512462 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abab7ee1-9c7f-4a7a-b770-f478660b9e91"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:12.515426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:12.523862 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:12.524959 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:12.525882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:12.527254 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:12.527887 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:12.528535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:13.010290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-362efe45-57e3-4e9e-af7a-b457fc3c17c0 req-49331e9c-b7ca-4d8a-8dc1-24ab0a4f59af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07", "tag": "434c6abc-e73a-47b5-8fda-e567642152ab"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:13.024756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-362efe45-57e3-4e9e-af7a-b457fc3c17c0 req-49331e9c-b7ca-4d8a-8dc1-24ab0a4f59af service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:13.025260 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-362efe45-57e3-4e9e-af7a-b457fc3c17c0 req-49331e9c-b7ca-4d8a-8dc1-24ab0a4f59af service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:13.025682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-362efe45-57e3-4e9e-af7a-b457fc3c17c0 req-49331e9c-b7ca-4d8a-8dc1-24ab0a4f59af service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:13.037949 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-362efe45-57e3-4e9e-af7a-b457fc3c17c0 req-49331e9c-b7ca-4d8a-8dc1-24ab0a4f59af service nova] Creating event network-changed:434c6abc-e73a-47b5-8fda-e567642152ab for instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 on hv-cinder-83976 Aug 30 12:14:13.044055 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-362efe45-57e3-4e9e-af7a-b457fc3c17c0 req-49331e9c-b7ca-4d8a-8dc1-24ab0a4f59af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038051 Aug 30 12:14:13.049192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 377/747] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:13.256120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:13.257126 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:13.270709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:13.271330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:13.272892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:13.273914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:13.274446 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:13.274942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:13.501746 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:13.510841 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-973808eb-7ab3-42af-aeea-37093c7f137e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.259054 Aug 30 12:14:13.524586 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 378/748] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:13 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:13.539052 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:13.539974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:13.552097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:13.552886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:13.553469 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:13.554337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:13.554950 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:13.555531 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:13.752448 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:13.765399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:13.767380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:13.768986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-86cdd93a-1897-4200-b7bb-a7b2d37b57b1 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.242977 Aug 30 12:14:13.770075 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 379/749] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:13 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:14.536069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:14.536749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:14.542851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:14.543668 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:14.544332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:14.545359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:14.546053 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:14.547096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:14.698352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:14.708035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-43f20780-e1a2-4ba4-aab7-0ab62badb76a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.177050 Aug 30 12:14:14.720955 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 380/750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:14 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:14.792685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:14.793227 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:14.795129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:14.800201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:14.800685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:14.801125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:14.806845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:14.806845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:14.806845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:14.966439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:14.976123 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:14.977836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:14.979014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d2606ca0-6c64-4bef-bdb0-e21b415e41b3 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.190314 Aug 30 12:14:14.979583 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 381/751] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:14 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:14:15.731761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:15.732821 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:15.741404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:15.741990 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:15.742539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:15.743297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:15.743811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:15.744308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:16.040970 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:16.048980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-926d2d81-ef77-475e-8ac7-bc8ed6e4de51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.322616 Aug 30 12:14:16.050687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 382/752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:15 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:16.055489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:16.056225 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:16.066382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:16.066564 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:16.067011 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:16.067746 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:16.068345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:16.068691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:16.214260 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:16.223385 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:16.224837 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:16.225997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2ef9c590-2a0f-48f0-a24b-874953f4e441 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.174339 Aug 30 12:14:16.226748 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 383/753] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:16 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:17.073373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:17.074372 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:17.081132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:17.081752 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:17.084391 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:17.084391 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:17.084391 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:17.084391 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:17.245931 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:17.255522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bdd7fcb1-6d35-4867-800c-312734810609 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.187930 Aug 30 12:14:17.256139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 384/754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:17 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:17.260807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:17.261445 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:17.269552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:17.270010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:17.270490 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:17.271198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:17.271664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:17.272152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:17.429230 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:17.439758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:17.441400 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:17.443392 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-316570ef-7cb8-4821-8ab0-a357b5e6e05e tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.185579 Aug 30 12:14:17.443392 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 385/755] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:17 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:18.277386 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:18.278138 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:18.285376 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:18.285868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:18.286304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:18.287060 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:18.287520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:18.287963 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:18.425359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:18.436399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f9710dab-a1cd-4130-8f05-875a87ff2952 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.162967 Aug 30 12:14:18.437877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 386/756] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:18 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:18.465971 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:18.466574 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:18.472891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:18.473368 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:18.473797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:18.474479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:18.474928 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:18.475349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:18.501657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=14 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:18.622551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:18.631638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:18.633225 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:18.634396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-36b2af42-241f-4cce-9bd8-a8151b20b4bc tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.172280 Aug 30 12:14:18.635192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 387/757] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:18 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:14:19.456808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:19.457470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:19.463974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:19.464473 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:19.464904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:19.465588 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:19.466036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:19.466454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:19.598039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:19.608488 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0575c520-ddd1-40b8-afb0-1907c2434977 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.155017 Aug 30 12:14:19.613380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 388/758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:19 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:19.659996 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:19.660939 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:19.667815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:19.668816 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:19.669254 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:19.669952 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:19.670402 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:19.670820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:19.925070 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:19.930792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=4 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:19.933890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:19.935343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:19.936540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e92ca0c8-a12c-4e4d-a5a9-58b6fd45a037 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.282505 Aug 30 12:14:19.938320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 389/759] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:19 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:20.351202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-3ed59dd5-0294-4aab-acd0-1f7d4643fb47 req-98986391-8609-4cda-b987-dbd6bfd2777a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cecfc5-00b5-4622-bdd8-146775076449", "tag": "8857a41e-2e83-4898-8bad-9c9fd9ab711d"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:20.361978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-3ed59dd5-0294-4aab-acd0-1f7d4643fb47 req-98986391-8609-4cda-b987-dbd6bfd2777a service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:20.362453 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-3ed59dd5-0294-4aab-acd0-1f7d4643fb47 req-98986391-8609-4cda-b987-dbd6bfd2777a service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:20.362878 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-3ed59dd5-0294-4aab-acd0-1f7d4643fb47 req-98986391-8609-4cda-b987-dbd6bfd2777a service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:20.373670 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-3ed59dd5-0294-4aab-acd0-1f7d4643fb47 req-98986391-8609-4cda-b987-dbd6bfd2777a service nova] Creating event network-changed:8857a41e-2e83-4898-8bad-9c9fd9ab711d for instance 50cecfc5-00b5-4622-bdd8-146775076449 on hv-cinder-83976 Aug 30 12:14:20.378770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-3ed59dd5-0294-4aab-acd0-1f7d4643fb47 req-98986391-8609-4cda-b987-dbd6bfd2777a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 Aug 30 12:14:20.379561 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 390/760] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:14:20.630786 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:20.631523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:20.637777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:20.638260 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:20.638702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:20.639392 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:20.639864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:20.640672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:20.838274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:20.848908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5cb49ee5-d8cb-4864-bdeb-40cf24a016c1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.222738 Aug 30 12:14:20.849758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 391/761] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:20 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:20.960190 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:20.960926 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:20.967819 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:20.969860 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:20.970307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:20.971363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:20.972024 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:20.972455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:21.145244 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:21.153609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:21.155052 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:21.156295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e11c2bab-8998-4140-8bc6-6d50692e6055 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.200343 Aug 30 12:14:21.156876 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 392/762] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:20 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:14:21.262032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5a3530f2-00f7-4132-8652-ad18b7794fc2 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.753439 Aug 30 12:14:21.269370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 371/763] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:14:12 2022] POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments => generated 194 bytes in 8762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:14:21.870908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:21.871460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:21.878956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:21.879442 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:21.880036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:21.880738 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:21.881195 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:21.881624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:21.901080 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:22.018337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:22.025961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bec53e5e-acad-4808-b2f4-241b76238a44 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.159217 Aug 30 12:14:22.026528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 393/764] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:21 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:22.179844 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:22.180476 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:22.187881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:22.188381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:22.188836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:22.189481 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:22.189931 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:22.190347 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:22.325716 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:22.334628 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:22.336113 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:22.337251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3c0169a7-63f5-4b01-9fb5-17a9109e80c0 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.162274 Aug 30 12:14:22.344634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 372/765] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:22 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:14:23.047339 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:23.048081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:23.054585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:23.055073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:23.055514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:23.056276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:23.056739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:23.057166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:23.200341 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:23.209142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-35d3564c-41fd-4fec-b2f1-a0d4a6f6d14c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.165797 Aug 30 12:14:23.209711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 394/766] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:23 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:23.361339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:23.361940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:23.368497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:23.369008 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:23.369437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:23.370127 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:23.370578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:23.371000 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:23.502640 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:23.510893 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:23.512538 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:23.513702 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-70fe1744-1f86-4a52-b5de-7e1248597f92 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.156408 Aug 30 12:14:23.514255 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 373/767] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:23 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:24.231300 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:24.231923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:24.239072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:24.239549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:24.240018 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:24.240715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:24.241175 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:24.241601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:24.391226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:24.391226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-843b9c7e-f09e-4bb4-95a7-6978e974152c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.159551 Aug 30 12:14:24.391226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 395/768] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:24 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:24.537886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:24.538580 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:24.544939 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:24.545423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:24.545847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:24.547302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:24.547836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:24.548354 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:24.690470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:24.699764 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:24.701268 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:24.702441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ef893a5e-673d-41d6-b1d3-cba11421f1c9 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.168568 Aug 30 12:14:24.703054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 374/769] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:24 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:25.182451 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-8b364ab8-224f-4456-84ab-23783548685f req-1c0bd306-8c5e-4ea9-8b13-bd45b316a445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a946d9a-667e-4a85-bd51-7ffee16f8905", "name": "network-vif-plugged", "status": "completed", "tag": "5634a068-6874-4e11-8b3a-39d600ea396c"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:25.192203 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-8b364ab8-224f-4456-84ab-23783548685f req-1c0bd306-8c5e-4ea9-8b13-bd45b316a445 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:25.192783 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-8b364ab8-224f-4456-84ab-23783548685f req-1c0bd306-8c5e-4ea9-8b13-bd45b316a445 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:25.193286 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-8b364ab8-224f-4456-84ab-23783548685f req-1c0bd306-8c5e-4ea9-8b13-bd45b316a445 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:25.205038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-8b364ab8-224f-4456-84ab-23783548685f req-1c0bd306-8c5e-4ea9-8b13-bd45b316a445 service nova] Creating event network-vif-plugged:5634a068-6874-4e11-8b3a-39d600ea396c for instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 on hv-cinder-83976 Aug 30 12:14:25.210126 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-8b364ab8-224f-4456-84ab-23783548685f req-1c0bd306-8c5e-4ea9-8b13-bd45b316a445 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031284 Aug 30 12:14:25.210716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 396/770] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:25.408778 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:25.409395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:25.415682 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:25.416195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:25.416628 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:25.417318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:25.417773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:25.418197 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:25.557009 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:25.565822 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5ad317b6-7ad3-47d9-8525-78c40df4295e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.161863 Aug 30 12:14:25.566467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 375/771] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:25 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:25.726269 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:25.726942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:25.733398 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:25.733898 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:25.734407 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:25.735101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:25.736185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:25.736622 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:25.871672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:25.880628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:25.882064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:25.883209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9355e04c-0a5d-46d8-82f9-ef89fd471444 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.161781 Aug 30 12:14:25.883810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 397/772] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:25 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:26.586570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:26.587239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:26.589699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=73 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:26.594323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:26.595361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:26.595811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:26.596480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:26.604705 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:26.604705 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:26.730332 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:26.737958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-47cacffb-b181-4f53-ba36-2af4b3eebce1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.155251 Aug 30 12:14:26.738522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 376/773] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:26 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:26.906431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:26.907044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:26.914443 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:26.914936 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:26.915378 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:26.916096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:26.917008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:26.917008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:27.053788 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:27.062287 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:27.064296 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:27.065916 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b56fadf9-ba44-4db6-8948-b9d29ea54192 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.163219 Aug 30 12:14:27.066465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 398/774] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:26 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:27.224605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-91e72343-19e7-4002-bf89-9b3f6d4c4833 req-76b9085a-cfa6-4985-be9a-147266dc16b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cecfc5-00b5-4622-bdd8-146775076449", "name": "network-vif-plugged", "status": "completed", "tag": "8857a41e-2e83-4898-8bad-9c9fd9ab711d"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:27.234644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-91e72343-19e7-4002-bf89-9b3f6d4c4833 req-76b9085a-cfa6-4985-be9a-147266dc16b2 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:27.235163 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-91e72343-19e7-4002-bf89-9b3f6d4c4833 req-76b9085a-cfa6-4985-be9a-147266dc16b2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:27.235588 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-91e72343-19e7-4002-bf89-9b3f6d4c4833 req-76b9085a-cfa6-4985-be9a-147266dc16b2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:27.246679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-91e72343-19e7-4002-bf89-9b3f6d4c4833 req-76b9085a-cfa6-4985-be9a-147266dc16b2 service nova] Creating event network-vif-plugged:8857a41e-2e83-4898-8bad-9c9fd9ab711d for instance 50cecfc5-00b5-4622-bdd8-146775076449 on hv-cinder-83976 Aug 30 12:14:27.251696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-91e72343-19e7-4002-bf89-9b3f6d4c4833 req-76b9085a-cfa6-4985-be9a-147266dc16b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030799 Aug 30 12:14:27.253118 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 377/775] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:27.759829 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:27.760652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:27.766636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:27.767108 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:27.767533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:27.768237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:27.768688 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:27.769107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:27.900608 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:27.909456 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8ffcd795-6f63-4239-99e6-fb4f1001fd24 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.153936 Aug 30 12:14:27.910099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 399/776] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:27 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:28.090124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:28.090808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:28.097771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:28.098247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:28.098673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:28.099348 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:28.099795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:28.100239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:28.232978 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:28.241539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:28.242975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:28.244135 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6eb98ee8-39b8-4568-890c-f00b1c2eec28 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1729 microversion: 2.20 time: 0.158686 Aug 30 12:14:28.244691 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 378/777] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:28 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:28.931002 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:28.931546 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:28.938011 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:28.942994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:28.942994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:28.942994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:28.942994 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:28.943352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:29.077406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:29.088166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d8d814a3-5478-45de-9b4a-9bd12241efd6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1366 microversion: 2.1 time: 0.161031 Aug 30 12:14:29.088833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 400/778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:28 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:29.266804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:29.267415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:29.274033 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:29.274519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:29.274946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:29.275624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:29.276114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:29.276534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:29.407027 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:29.415754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:29.417209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:29.418427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-faf69899-95c4-4989-a785-abe7c6b25c9f tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1716 microversion: 2.20 time: 0.155716 Aug 30 12:14:29.418976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 379/779] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:14:29 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:14:30.111857 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:30.112630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:30.119153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:30.119638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:30.120102 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:30.120862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:30.121314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:30.121735 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:30.253519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:30.261399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-01e320f4-78c8-488a-b85a-a72ff7adff39 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1557 microversion: 2.1 time: 0.153565 Aug 30 12:14:30.261965 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 401/780] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:30 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:30.282399 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:30.282933 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:30.289238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:30.289713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:30.290167 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:30.290839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:30.291283 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:30.291695 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:30.369184 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d5c9d227-7e35-4f7c-a1b1-60e8cdec66f0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090318 Aug 30 12:14:30.369616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 380/781] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:14:30 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:30.970408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:30.972326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:30.981459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:30.982352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:30.983156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:30.984479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:30.985305 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:30.986098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:31.206298 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:31.214868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9b1a6ffe-5f97-4460-9f2a-4c1c8694d098 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1593 microversion: 2.1 time: 0.248606 Aug 30 12:14:31.215444 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 402/782] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:30 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1593 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:31.474551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-930d14f6-c082-4c9f-962f-aceafed8f174 req-e9bdaf19-fa52-48c2-8371-837dada0d78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cecfc5-00b5-4622-bdd8-146775076449", "tag": "8857a41e-2e83-4898-8bad-9c9fd9ab711d"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:31.485092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-930d14f6-c082-4c9f-962f-aceafed8f174 req-e9bdaf19-fa52-48c2-8371-837dada0d78b service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:31.486377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-930d14f6-c082-4c9f-962f-aceafed8f174 req-e9bdaf19-fa52-48c2-8371-837dada0d78b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:31.487502 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-930d14f6-c082-4c9f-962f-aceafed8f174 req-e9bdaf19-fa52-48c2-8371-837dada0d78b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:31.499134 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-930d14f6-c082-4c9f-962f-aceafed8f174 req-e9bdaf19-fa52-48c2-8371-837dada0d78b service nova] Creating event network-changed:8857a41e-2e83-4898-8bad-9c9fd9ab711d for instance 50cecfc5-00b5-4622-bdd8-146775076449 on hv-cinder-83976 Aug 30 12:14:31.504985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-930d14f6-c082-4c9f-962f-aceafed8f174 req-e9bdaf19-fa52-48c2-8371-837dada0d78b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034810 Aug 30 12:14:31.506062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 381/783] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:33.717737 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-705124ea-dc56-4941-a22a-0c64b51750c6 req-4cf05dce-b4b6-44ff-a0dd-cda8726a7cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d3c7d0-1615-465b-9099-7ebed6b4f402", "tag": "c119f48c-5cdc-4730-83b4-4520b61dc812"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:33.725995 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-705124ea-dc56-4941-a22a-0c64b51750c6 req-4cf05dce-b4b6-44ff-a0dd-cda8726a7cb6 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:33.726652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-705124ea-dc56-4941-a22a-0c64b51750c6 req-4cf05dce-b4b6-44ff-a0dd-cda8726a7cb6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:33.727179 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-705124ea-dc56-4941-a22a-0c64b51750c6 req-4cf05dce-b4b6-44ff-a0dd-cda8726a7cb6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:33.742264 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-705124ea-dc56-4941-a22a-0c64b51750c6 req-4cf05dce-b4b6-44ff-a0dd-cda8726a7cb6 service nova] Creating event network-changed:c119f48c-5cdc-4730-83b4-4520b61dc812 for instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 on hv-cinder-83976 Aug 30 12:14:33.747481 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-705124ea-dc56-4941-a22a-0c64b51750c6 req-4cf05dce-b4b6-44ff-a0dd-cda8726a7cb6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038001 Aug 30 12:14:33.748229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 403/784] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:35.966563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-780873986"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:35.967180 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:35.973414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:35.973904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:35.974337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:35.975022 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:35.975475 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:35.975898 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:36.103307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.network.security_group_api [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Adding security group e2a3d227-b835-4997-9505-9407ed73ad7f to port c119f48c-5cdc-4730-83b4-4520b61dc812 Aug 30 12:14:36.503909 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-861c1d9c-c213-4e81-893a-301338af2e76 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/action" status: 202 len: 0 microversion: 2.1 time: 0.542096 Aug 30 12:14:36.511208 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 382/785] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:14:35 2022] POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:14:36.513435 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:36.513969 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-1dc33a1e-62a2-47df-9f46-e16e27804671 req-981a954c-1321-498e-8353-ae2e5faa3479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d3c7d0-1615-465b-9099-7ebed6b4f402", "tag": "c119f48c-5cdc-4730-83b4-4520b61dc812"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:36.514166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:36.521144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:36.521781 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:36.522216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:36.523187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:36.523601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-1dc33a1e-62a2-47df-9f46-e16e27804671 req-981a954c-1321-498e-8353-ae2e5faa3479 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:36.523713 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:36.524081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:36.524203 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-1dc33a1e-62a2-47df-9f46-e16e27804671 req-981a954c-1321-498e-8353-ae2e5faa3479 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:36.524617 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-1dc33a1e-62a2-47df-9f46-e16e27804671 req-981a954c-1321-498e-8353-ae2e5faa3479 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:36.546411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-1dc33a1e-62a2-47df-9f46-e16e27804671 req-981a954c-1321-498e-8353-ae2e5faa3479 service nova] Creating event network-changed:c119f48c-5cdc-4730-83b4-4520b61dc812 for instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 on hv-cinder-83976 Aug 30 12:14:36.552471 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-1dc33a1e-62a2-47df-9f46-e16e27804671 req-981a954c-1321-498e-8353-ae2e5faa3479 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041953 Aug 30 12:14:36.553745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 383/786] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:36.675595 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:36.684544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-010f33d5-b013-44eb-b672-9ed8f04e5390 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1758 microversion: 2.1 time: 0.175465 Aug 30 12:14:36.685114 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 404/787] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:36 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:50.681139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=15 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:50.681872 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:50.685976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:50.688257 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:50.694888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:50.695374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:50.695808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:50.696551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:50.697004 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:50.697429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:50.927639 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ca0b9980-1d85-4fb8-bfa2-7386bbffc41e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/action" status: 202 len: 0 microversion: 2.1 time: 0.247903 Aug 30 12:14:50.928332 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 384/788] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:14:50 2022] POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:14:50.937100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:50.937677 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:50.940123 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=47 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:50.940775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=60 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:14:50.945588 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:50.947424 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:50.947424 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:50.947424 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:50.947701 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:50.948120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:51.102551 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:51.111106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ede91a90-3ba6-409c-ba43-716026f1d862 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1750 microversion: 2.1 time: 0.178525 Aug 30 12:14:51.116090 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 405/789] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:50 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:52.134372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:52.135056 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:52.141172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:52.141652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:52.142083 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:52.142761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:52.143208 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:52.143624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:52.298469 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:52.308825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-59a10670-b0db-4bd7-9b25-f27b5dee1a08 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.179343 Aug 30 12:14:52.309253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 385/790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:52 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:52.352261 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:52.352782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:52.359315 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:52.359791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:52.360330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:52.361023 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:52.361475 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:52.361892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:52.387779 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b3970b49-61f0-4b8d-983f-44a8912b601c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/ips" status: 200 len: 146 microversion: 2.1 time: 0.155405 Aug 30 12:14:52.388367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 406/791] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:14:52 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/ips => generated 146 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:14:53.333441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:53.334194 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:53.343146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:53.343881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:53.344579 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:53.345633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:53.346336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:53.346993 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:53.503614 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:53.511735 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7de6e769-704b-4bd9-8d99-f0560748012c tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.182348 Aug 30 12:14:53.512414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 386/792] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:53 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:54.007676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40ad23c4-e777-4898-acee-cf4b99b0f12b"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:14:54.010108 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:54.016524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:54.017014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:54.017454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:54.018763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:54.019256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:54.020541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:54.532220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:54.532835 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:54.539763 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:54.540307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:54.540749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:54.541445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:54.541897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:54.542323 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:54.683076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:54.691321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c5948020-e500-4903-972b-7ba2b74204f8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.162980 Aug 30 12:14:54.694346 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 387/793] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:54 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:14:54.776827 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ceb11f2d-a032-474c-b451-16438ecfe20c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773744 Aug 30 12:14:54.777412 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 407/794] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:14:54 2022] POST /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:14:55.713870 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:55.714468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:55.721561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:55.722041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:55.722634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:55.723440 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:55.724001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:55.724428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:55.871633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:55.880752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f3866e90-cacc-4d55-81be-12b683885738 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.171230 Aug 30 12:14:55.881256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 388/795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:55 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:56.903637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:56.904347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:56.910852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:56.911992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:56.912484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:56.913228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:56.913682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:56.914104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:57.057408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:57.065709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3817140a-7949-4841-95c2-312b696d0055 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.167125 Aug 30 12:14:57.066277 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 408/796] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:56 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:58.087450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:58.088097 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:58.094485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:58.094974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:58.095407 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:58.096140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:58.096600 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:58.097027 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:58.238184 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:58.247202 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f05376a5-cdc0-4001-9fde-d697e7e1b6f0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.164400 Aug 30 12:14:58.247883 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 389/797] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:58 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:14:59.269491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:14:59.270097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:14:59.276958 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:59.277428 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:59.277906 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:59.278533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:14:59.278981 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:14:59.279399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:14:59.422003 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:14:59.430989 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-18bf60a4-d5e6-48f4-9137-8115892e8203 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.165336 Aug 30 12:14:59.431555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 409/798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:14:59 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:00.452402 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:00.452945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:00.459633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:00.460160 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:00.460599 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:00.461285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:00.461767 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:00.462192 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:00.602227 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:00.610652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-eb3eb092-336c-4a12-9bec-db7b49c8cb6e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.162141 Aug 30 12:15:00.611218 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 390/799] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:00 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:01.631401 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:01.632007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:01.638604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:01.639087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:01.639516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:01.640377 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:01.640946 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:01.641449 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:01.792887 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:01.801082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6ea7a9cd-9f7f-48a0-954a-40326f6e44a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.174048 Aug 30 12:15:01.805980 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 410/800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:01 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:02.823354 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:02.824080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:02.830801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:02.831286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:02.831720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:02.832461 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:02.832914 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:02.833388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:02.990696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:02.998878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6a934c18-4d54-45e8-9906-d419505046e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.179466 Aug 30 12:15:02.999436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 391/801] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:02 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:03.368402 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:03.370613 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:03.377036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:03.377512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:03.377941 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:03.378620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:03.379073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:03.379496 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:03.410187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a95995d1-d584-442c-b877-8d089dadf014 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Aug 30 12:15:03.410732 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 411/802] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:03 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:03.421555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:03.422090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:03.428327 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:03.428815 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:03.429256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:03.429944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:03.430403 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:03.430829 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:03.460848 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f447da5b-5a38-48b7-86f0-9168841cecad tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/40ad23c4-e777-4898-acee-cf4b99b0f12b" status: 200 len: 194 microversion: 2.1 time: 0.043128 Aug 30 12:15:03.461433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 392/803] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Aug 30 12:15:03 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/40ad23c4-e777-4898-acee-cf4b99b0f12b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:04.020422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:04.021073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:04.027094 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:04.031709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:04.031709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:04.031709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:04.031709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:04.032672 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:04.179135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:04.187499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8b67cfc0-3e0f-46cb-a2c6-fdf1fe30c9c0 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.171089 Aug 30 12:15:04.188084 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 412/804] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:04 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:05.076517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86514ddb-219b-4577-85f2-99d664618f34"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:05.078804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:05.085815 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:05.086303 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:05.086736 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:05.087417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:05.087880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:05.088335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:05.210656 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:05.213171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:05.218134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:05.218624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:05.219047 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:05.219736 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:05.220218 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:05.220639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:05.368791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:05.377463 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7e7c7eeb-4cbd-4830-a88d-7cd2e80540a3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.171895 Aug 30 12:15:05.385132 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 413/805] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:05 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:05.806698 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-de8c8e42-0005-4283-8da3-112b898f4b4a tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "POST /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733905 Aug 30 12:15:05.807550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 393/806] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:15:05 2022] POST /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:06.398739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:06.399299 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:06.405709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:06.406195 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:06.406634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:06.407324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:06.407811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:06.408334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:06.550021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:06.558657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4ba18c8c-b833-4d08-96cb-aae3c3f192e4 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.163943 Aug 30 12:15:06.559233 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 414/807] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:06 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:07.580828 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:07.581549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:07.588760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:07.589238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:07.589664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:07.590372 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:07.590820 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:07.591238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:07.737181 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:07.745994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-869aa078-0ece-4a7a-9573-a49606ca2e25 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1755 microversion: 2.1 time: 0.169344 Aug 30 12:15:07.746561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 394/808] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:07 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:15:08.766526 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:08.767144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:08.774312 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:08.778322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:08.778322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:08.778322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:08.778322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:08.778685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:08.921118 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:08.929924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e8cc943e-0f2e-482d-a6a6-0fd4485d9d5e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1758 microversion: 2.1 time: 0.167362 Aug 30 12:15:08.930497 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 415/809] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:08 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:10.632613 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:10.634843 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:10.641320 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:10.641808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:10.642245 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:10.642931 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:10.643390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:10.643819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:10.672813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-40583fad-5082-4a1c-87c2-4dfefe492a21 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045028 Aug 30 12:15:10.673361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 395/810] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Aug 30 12:15:10 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:10.734162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:10.734651 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:10.741160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:10.741638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:10.742070 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:10.742748 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:10.743196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:10.743612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:10.769533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:15:11.066943 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f0bc49a8-fc1d-4231-b6cd-8258f2c8228d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 204 len: 0 microversion: 2.20 time: 0.336597 Aug 30 12:15:11.068171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 416/811] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Aug 30 12:15:10 2022] DELETE /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 12:15:11.076327 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:11.076980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:11.082896 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:11.083422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:11.083845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:11.084549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:11.085030 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:11.085450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:11.225187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:11.233419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:11.237583 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:11.237583 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-79746884-510b-4240-ac3f-26bf1dd118d5 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.163480 Aug 30 12:15:11.237583 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 396/812] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:15:11 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:15:12.259297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:12.260035 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:12.266745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:12.267362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:12.267801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:12.268564 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:12.269017 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:12.269444 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:12.398968 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:12.406905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:12.408399 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:12.409550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7725d283-e4c3-4144-be73-009e0a0a026a tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.154692 Aug 30 12:15:12.410107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 417/813] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:15:12 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:15:13.432490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:13.433097 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:13.439516 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:13.440027 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:13.440486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:13.441141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:13.441587 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:13.442008 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:13.923184 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:13.934732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:13.936500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:13.937656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3f2b42d9-bc4d-4b68-b176-def28e78fd42 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1722 microversion: 2.20 time: 0.509017 Aug 30 12:15:13.938207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 397/814] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:15:13 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1722 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 12:15:14.409255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:14.414149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:14.422174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.422899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.423627 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.425268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.425918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.426585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.434934 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-17bd1e28-ebc0-4a52-a091-e6d8725d0bcc req-6c3038d0-b1c5-43cb-ab74-3c56eed5a6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a946d9a-667e-4a85-bd51-7ffee16f8905", "name": "network-vif-deleted", "tag": "5634a068-6874-4e11-8b3a-39d600ea396c"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:14.444991 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-17bd1e28-ebc0-4a52-a091-e6d8725d0bcc req-6c3038d0-b1c5-43cb-ab74-3c56eed5a6d0 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.445475 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-17bd1e28-ebc0-4a52-a091-e6d8725d0bcc req-6c3038d0-b1c5-43cb-ab74-3c56eed5a6d0 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.445911 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-17bd1e28-ebc0-4a52-a091-e6d8725d0bcc req-6c3038d0-b1c5-43cb-ab74-3c56eed5a6d0 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.449958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:14.457294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-17bd1e28-ebc0-4a52-a091-e6d8725d0bcc req-6c3038d0-b1c5-43cb-ab74-3c56eed5a6d0 service nova] Creating event network-vif-deleted:5634a068-6874-4e11-8b3a-39d600ea396c for instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 on hv-cinder-83976 Aug 30 12:15:14.462464 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-17bd1e28-ebc0-4a52-a091-e6d8725d0bcc req-6c3038d0-b1c5-43cb-ab74-3c56eed5a6d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 Aug 30 12:15:14.463131 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 398/815] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:15:14.468957 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:14.478582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-15b4d74a-b324-464c-946c-1621ae5f3595 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.073629 Aug 30 12:15:14.479162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 418/816] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:14 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:14.603303 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:14.604231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:14.611581 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.612094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.612527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.613321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.613847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.614272 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.653943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2b9465c9-915b-4b81-8e22-a8b0ab49a0df tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/40ad23c4-e777-4898-acee-cf4b99b0f12b" status: 200 len: 194 microversion: 2.1 time: 0.055283 Aug 30 12:15:14.654549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 399/817] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Aug 30 12:15:14 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/40ad23c4-e777-4898-acee-cf4b99b0f12b => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:14.666082 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:14.666604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:14.673201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.677632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.677632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.678273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.678814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.679345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.765491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lazy-loading 'services' on Instance uuid 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:15:14.966874 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:14.967495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:14.974644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.975307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.975620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:14.976328 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:14.976781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:14.977211 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:15.011701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:15.012224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:15.012660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:15.013114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lazy-loading 'fault' on Instance uuid 9a946d9a-667e-4a85-bd51-7ffee16f8905 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:15:15.017054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5ccb014f-f759-4d4c-a18f-59f1e4825bcb tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/40ad23c4-e777-4898-acee-cf4b99b0f12b" status: 202 len: 0 microversion: 2.1 time: 0.355752 Aug 30 12:15:15.017732 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 419/818] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:15:14 2022] DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/40ad23c4-e777-4898-acee-cf4b99b0f12b => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:15:15.068432 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:15.077993 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:15.079659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c1d151da5cb4b27a2bf9b71e82d70dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bec3fcc71460eb8b7f89ecf66b816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:15.081027 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8f606534-bb38-47b7-bc53-97a81c6ef5a6 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 200 len: 1370 microversion: 2.20 time: 0.118218 Aug 30 12:15:15.082220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 400/819] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:15:14 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 1370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 12:15:16.108083 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:16.108808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:16.116199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:16.117034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:16.117468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:16.118171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:16.118619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:16.119044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:16.133397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] HTTP exception thrown: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Request method failure captured: Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 HTTP/1.1 Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2gc_rszzmO68_hMQTvH2UzM-_k9JkTSFQeh86UoNVDlwaYVzE54UJl6rMvUKeRePF74fpTI2D9YOlAXJwdCffLLW9HVqV7KTgKPCRnyAgLF2q7ssvxjS9QG_wY7RTUNSdKRZqt_DCdjxGPSNG1TndwfCNqqgBpX2V0aktAYf9JFrE Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:15:16.135079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 1c1d151da5cb4b27a2bf9b71e82d70dc Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:16.136849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '9a946d9a-667e-4a85-bd51-7ffee16f8905'} Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:16.137767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:16.139289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:16.140956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Returning 404 to user: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:16.140956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-85a70260-87dd-4050-b218-53f5c5ccc563 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 404 len: 111 microversion: 2.20 time: 0.034086 Aug 30 12:15:16.140956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 420/820] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:15:16 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:15:16.145687 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2cf877a6-0d9b-4ae2-b323-21e4d3aa3bab tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '.version_select at 0x7efe4edb3a60>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:16.219386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2cf877a6-0d9b-4ae2-b323-21e4d3aa3bab tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151487128" status: 204 len: 0 microversion: 2.20 time: 0.077416 Aug 30 12:15:16.220004 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 401/821] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Aug 30 12:15:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151487128 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 12:15:17.226723 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:17.232822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:17.235295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:17.235775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:17.236236 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:17.236927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:17.237377 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:17.237796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:17.275139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c204593c-521f-4776-aaaa-717e67164a19 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/86514ddb-219b-4577-85f2-99d664618f34" status: 200 len: 194 microversion: 2.1 time: 0.054014 Aug 30 12:15:17.276171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 421/822] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Aug 30 12:15:17 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/86514ddb-219b-4577-85f2-99d664618f34 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:17.288253 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:17.288769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:17.295937 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:17.296451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:17.296970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:17.297662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:17.298305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:17.298916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:17.381861 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lazy-loading 'services' on Instance uuid 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:15:17.572719 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d7ecc5a9-31a4-4fae-ac9f-d1c3551b49f4 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/86514ddb-219b-4577-85f2-99d664618f34" status: 202 len: 0 microversion: 2.1 time: 0.289918 Aug 30 12:15:17.573278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 402/823] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:15:17 2022] DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments/86514ddb-219b-4577-85f2-99d664618f34 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:15:17.817077 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:17.817654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:17.824353 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:17.824839 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:17.825326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:17.826010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:17.826461 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:17.826885 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:17.849761 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-60d6fd16-f770-4eea-95eb-069be1d663dc tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/ips" status: 200 len: 151 microversion: 2.1 time: 0.036548 Aug 30 12:15:17.850265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 422/824] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:15:17 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:18.550696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:18.551294 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:18.558336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:18.559047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:18.559488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:18.560188 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:18.560637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:18.561049 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:18.575805 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] HTTP exception thrown: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Request method failure captured: Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: DELETE /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 HTTP/1.1 Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2gc_rszzmO68_hMQTvH2UzM-_k9JkTSFQeh86UoNVDlwaYVzE54UJl6rMvUKeRePF74fpTI2D9YOlAXJwdCffLLW9HVqV7KTgKPCRnyAgLF2q7ssvxjS9QG_wY7RTUNSdKRZqt_DCdjxGPSNG1TndwfCNqqgBpX2V0aktAYf9JFrE Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:15:18.577555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 1c1d151da5cb4b27a2bf9b71e82d70dc Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.579173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '9a946d9a-667e-4a85-bd51-7ffee16f8905'} Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:18.580034 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.581629 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.584397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Returning 404 to user: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:18.584397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7d13dee2-9c3b-4eb9-b00d-074d665fd6c2 tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 404 len: 111 microversion: 2.20 time: 0.032971 Aug 30 12:15:18.584397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 403/825] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Aug 30 12:15:18 2022] DELETE /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:15:18.591519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:18.592213 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 9a946d9a-667e-4a85-bd51-7ffee16f8905] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:18.600628 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:18.609719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:18.609719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:18.609719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:18.609719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:18.610168 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:18.618856 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] HTTP exception thrown: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Request method failure captured: Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 HTTP/1.1 Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf2gc_rszzmO68_hMQTvH2UzM-_k9JkTSFQeh86UoNVDlwaYVzE54UJl6rMvUKeRePF74fpTI2D9YOlAXJwdCffLLW9HVqV7KTgKPCRnyAgLF2q7ssvxjS9QG_wY7RTUNSdKRZqt_DCdjxGPSNG1TndwfCNqqgBpX2V0aktAYf9JFrE Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:15:18.620430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 1c1d151da5cb4b27a2bf9b71e82d70dc Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.622206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '9a946d9a-667e-4a85-bd51-7ffee16f8905'} Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:18.623073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. Aug 30 12:15:18.624570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:18.626143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Returning 404 to user: Instance 9a946d9a-667e-4a85-bd51-7ffee16f8905 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:18.626143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fc3a448d-6d8e-4628-aa88-5ab705519e3c tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905" status: 404 len: 111 microversion: 2.20 time: 0.035030 Aug 30 12:15:18.626143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 423/826] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:15:18 2022] GET /compute/v2.1/servers/9a946d9a-667e-4a85-bd51-7ffee16f8905 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:15:18.763205 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:18.765538 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:18.771804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:18.772320 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:18.776233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:18.776233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:18.776233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:18.776233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:18.805371 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b5eb3416-f7a8-4526-8bfa-8040c65f462e tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046289 Aug 30 12:15:18.805938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 404/827] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:18 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:19.573143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0bfe56e-5abe-4848-be5b-bd8af2c491ef"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:19.575678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:19.582022 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.584314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.584314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:19.584510 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.584923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.585343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:19.817692 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:19.820866 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:19.827356 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.828039 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.828346 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:19.829061 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.829518 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.829943 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:19.860334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-79d96df4-c5b5-4daf-8d96-203faf2084a6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046683 Aug 30 12:15:19.860885 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 405/828] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:19 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 12:15:19.937098 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:19.937592 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:19.944270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.944753 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.945187 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:19.945877 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.946328 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.946752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:19.960444 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] HTTP exception thrown: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Request method failure captured: Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: DELETE /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc HTTP/1.1 Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2gc_rszzmO68_hMQTvH2UzM-_k9JkTSFQeh86UoNVDlwaYVzE54UJl6rMvUKeRePF74fpTI2D9YOlAXJwdCffLLW9HVqV7KTgKPCRnyAgLF2q7ssvxjS9QG_wY7RTUNSdKRZqt_DCdjxGPSNG1TndwfCNqqgBpX2V0aktAYf9JFrE Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:15:19.962080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 1c1d151da5cb4b27a2bf9b71e82d70dc Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:19.963720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '294a2d1c-a5ff-4f5e-945f-03a42a7800cc'} Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:19.964863 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:19.966377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:19.968773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Returning 404 to user: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:19.968773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0a4839b1-fa10-4904-a48d-a3675170c95d tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "DELETE /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 404 len: 111 microversion: 2.20 time: 0.030225 Aug 30 12:15:19.968773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 406/829] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Aug 30 12:15:19 2022] DELETE /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 12:15:19.980222 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:19.981100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] [instance: 294a2d1c-a5ff-4f5e-945f-03a42a7800cc] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:19.987308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.987764 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.988223 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:19.988908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:19.989361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:19.990321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:20.003814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] HTTP exception thrown: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Request method failure captured: Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc HTTP/1.1 Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf2gc_rszzmO68_hMQTvH2UzM-_k9JkTSFQeh86UoNVDlwaYVzE54UJl6rMvUKeRePF74fpTI2D9YOlAXJwdCffLLW9HVqV7KTgKPCRnyAgLF2q7ssvxjS9QG_wY7RTUNSdKRZqt_DCdjxGPSNG1TndwfCNqqgBpX2V0aktAYf9JFrE Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:15:20.006293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/218bec3fcc71460eb8b7f89ecf66b816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 218bec3fcc71460eb8b7f89ecf66b816 Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131757082 Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 1c1d151da5cb4b27a2bf9b71e82d70dc Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131757082-project Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:20.007905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '294a2d1c-a5ff-4f5e-945f-03a42a7800cc'} Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:20.008694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. Aug 30 12:15:20.009895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:20.011011 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] Returning 404 to user: Instance 294a2d1c-a5ff-4f5e-945f-03a42a7800cc could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:20.011011 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c9401f92-c799-444d-8f79-1eaf510c03fe tempest-AttachVolumeShelveTestJSON-2131757082 tempest-AttachVolumeShelveTestJSON-2131757082-project] 10.222.0.42 "GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc" status: 404 len: 111 microversion: 2.20 time: 0.033157 Aug 30 12:15:20.011011 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 407/830] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Aug 30 12:15:19 2022] GET /compute/v2.1/servers/294a2d1c-a5ff-4f5e-945f-03a42a7800cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:15:20.013083 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:20.015195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:20.021195 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:20.022035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:20.022533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:20.023229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:20.023688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:20.024142 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:20.056650 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-149adc8b-117f-47be-a5f3-498775e0a2a5 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046655 Aug 30 12:15:20.057229 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 408/831] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:20 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:15:20.121076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:20.121819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:20.127647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:20.128170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:20.128616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:20.129297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:20.129755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:20.130168 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:20.157436 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:15:20.280139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-69bb222d-a112-432b-b383-73332b3a5366 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711507 Aug 30 12:15:20.281045 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 424/832] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:15:19 2022] POST /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:20.450510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5b2f5ce9-ba92-4f32-8955-7d4b680bf51d tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 204 len: 0 microversion: 2.1 time: 0.333044 Aug 30 12:15:20.451100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 409/833] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:15:20 2022] DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:15:20.461166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:20.461901 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:20.468209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:20.468702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:20.469174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:20.469868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:20.470387 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:20.470813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:20.704297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:20.712051 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-56b2a70e-6a11-4360-ab13-889e40d05192 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1673 microversion: 2.1 time: 0.256411 Aug 30 12:15:20.712623 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 425/834] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:20 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:21.734125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:21.734958 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:21.738951 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:21.742829 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:21.743321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:21.743755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:21.744560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:21.745021 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:21.745446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:21.945921 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:21.959292 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c766ed2e-7bf9-49ee-adf7-d4e3fe9d3497 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1673 microversion: 2.1 time: 0.228906 Aug 30 12:15:21.960830 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 410/835] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:21 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:22.988947 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:22.990641 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:22.995546 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:23.000229 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:23.001134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:23.001836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:23.002851 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:23.003520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:23.004304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:23.242753 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:23.255654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bce44428-5eb6-458f-9c4f-b4f9b535a058 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1673 microversion: 2.1 time: 0.269953 Aug 30 12:15:23.256426 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 426/836] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:22 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:23.496073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-aa47cd84-36a7-4efe-9ed8-e09a6a0c3b8b req-5a45b808-b8f7-45d7-a556-c1264ef4d435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b", "name": "network-vif-deleted", "tag": "f90bc006-c400-441e-8ad0-da8e74217fdf"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:23.534115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-aa47cd84-36a7-4efe-9ed8-e09a6a0c3b8b req-5a45b808-b8f7-45d7-a556-c1264ef4d435 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:23.536298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-aa47cd84-36a7-4efe-9ed8-e09a6a0c3b8b req-5a45b808-b8f7-45d7-a556-c1264ef4d435 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:23.537464 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-aa47cd84-36a7-4efe-9ed8-e09a6a0c3b8b req-5a45b808-b8f7-45d7-a556-c1264ef4d435 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:23.552474 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-aa47cd84-36a7-4efe-9ed8-e09a6a0c3b8b req-5a45b808-b8f7-45d7-a556-c1264ef4d435 service nova] Creating event network-vif-deleted:f90bc006-c400-441e-8ad0-da8e74217fdf for instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b on hv-cinder-83976 Aug 30 12:15:23.558730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-aa47cd84-36a7-4efe-9ed8-e09a6a0c3b8b req-5a45b808-b8f7-45d7-a556-c1264ef4d435 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066993 Aug 30 12:15:23.560442 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 411/837] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:24.276959 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:24.277580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:24.284378 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:24.284771 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:24.285242 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:24.285942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:24.286404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:24.287566 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:24.322367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:24.322866 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:24.323307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:24.323768 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lazy-loading 'fault' on Instance uuid 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:15:24.381296 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0c4a52ae34e71bda4903c305b58a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e118000fea4e5e91d716d7612bb9e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:24.390206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-22adfdd7-d8a1-4157-94ee-9290d276d978 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 200 len: 1326 microversion: 2.1 time: 0.117210 Aug 30 12:15:24.391467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 427/838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:24 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:25.413171 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:25.414090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:25.420198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:25.420682 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:25.421115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:25.421799 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:25.422252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:25.422673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:25.436780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] HTTP exception thrown: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Request method failure captured: Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b HTTP/1.1 Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf3w_fO86aHLQ0Ek6v8HP_HA_q9cj_WeOkMwOsPhF-jQjwN0wfbtOqvHSJxkoe09edbOYJwqbl7sbOHxY8vf0nLvu14JhuO5JIZchkv2xqY-s431Mdsx40t0iSHytHTIX44wac1ez6kZpPOi-oNqu48QQLxysIwll1mj80hWa_ZwGFI Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:15:25.438431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 04a0c4a52ae34e71bda4903c305b58a4 Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:25.443455 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b'} Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:25.444946 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:25.446238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:25.447528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Returning 404 to user: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:25.447528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8722192b-a099-4505-b1d0-710fea562a01 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 404 len: 111 microversion: 2.1 time: 0.031344 Aug 30 12:15:25.447528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 412/839] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:25 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:15:25.452322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4a70e62d-2e8a-41d2-8305-93083496f1a8 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '.version_select at 0x7efe4ee0ea60>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:25.559992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4a70e62d-2e8a-41d2-8305-93083496f1a8 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748835344" status: 202 len: 0 microversion: 2.1 time: 0.113606 Aug 30 12:15:25.564313 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 428/840] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Aug 30 12:15:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748835344 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:15:28.951050 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:28.952240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:28.957873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:28.958356 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:28.958893 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:28.959885 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:28.960575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:28.961005 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:28.975538 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] HTTP exception thrown: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Request method failure captured: Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b HTTP/1.1 Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf3w_fO86aHLQ0Ek6v8HP_HA_q9cj_WeOkMwOsPhF-jQjwN0wfbtOqvHSJxkoe09edbOYJwqbl7sbOHxY8vf0nLvu14JhuO5JIZchkv2xqY-s431Mdsx40t0iSHytHTIX44wac1ez6kZpPOi-oNqu48QQLxysIwll1mj80hWa_ZwGFI Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:15:28.977204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 04a0c4a52ae34e71bda4903c305b58a4 Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:28.978551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b'} Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:28.979298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:28.980641 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:28.983321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Returning 404 to user: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:28.983321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f479fcc4-6d49-460f-8b97-690fa6fc27db tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 404 len: 111 microversion: 2.1 time: 0.031447 Aug 30 12:15:28.983321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 413/841] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:15:28 2022] DELETE /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:15:28.988193 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:28.988961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:28.996391 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:28.996886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:28.997322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:28.998020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:28.998499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:28.998987 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:29.013049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] HTTP exception thrown: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Request method failure captured: Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b HTTP/1.1 Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf3w_fO86aHLQ0Ek6v8HP_HA_q9cj_WeOkMwOsPhF-jQjwN0wfbtOqvHSJxkoe09edbOYJwqbl7sbOHxY8vf0nLvu14JhuO5JIZchkv2xqY-s431Mdsx40t0iSHytHTIX44wac1ez6kZpPOi-oNqu48QQLxysIwll1mj80hWa_ZwGFI Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:15:29.014718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 04a0c4a52ae34e71bda4903c305b58a4 Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:29.016344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b'} Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:29.017307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. Aug 30 12:15:29.018845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:29.020265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Returning 404 to user: Instance 1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:29.020265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0372198d-964f-433a-91c0-76c09b095d4f tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b" status: 404 len: 111 microversion: 2.1 time: 0.032393 Aug 30 12:15:29.020265 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 429/842] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:28 2022] GET /compute/v2.1/servers/1fe4aef3-edb6-4eb3-b9cb-5bb7b7f0743b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:15:29.937828 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c9ef87a9-c502-4657-9104-ef87d29aba60 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: .version_select at 0x7efe4eddf1f0>, body: {"keypair": {"name": "tempest-keypair-416833577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrAEooOCQWVES1jhK1KQZoEKrZ8aFfkWpTWpEc8lvx9CskYU8vGfA/jp4D4ahl8MqA7amPXKs3hy21qGkXZK2AF5Vb/sq+JEtp4yHoAnnMP9ZX29sWyQ0uceMn7l2OmIQ=="}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:29.953373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-c9ef87a9-c502-4657-9104-ef87d29aba60 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:15:29.957531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-c9ef87a9-c502-4657-9104-ef87d29aba60 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:15:30.040316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c9ef87a9-c502-4657-9104-ef87d29aba60 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106255 Aug 30 12:15:30.040944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 414/843] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:15:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:32.292987 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1313145516", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5440e9-8593-4ddc-a45f-ad471b8efbac"}], "security_groups": [{"name": "tempest-securitygroup--2025563380"}], "key_name": "tempest-keypair-416833577", "user_data": "}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:32.402323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] validate_networks() for [('4d5440e9-8593-4ddc-a45f-ad471b8efbac', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:15:32.780643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:15:32.781062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:15:32.781530 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:15:32.781934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:15:32.782338 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:15:32.791714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:32.792218 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:32.792647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:32.793387 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:32.793834 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:32.794308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:32.811257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:15:32.815176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:15:32.826974 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:15:32.829287 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:15:33.014879 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-40a4ef43-c079-4f4a-9cff-5253a348cbfe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.727167 Aug 30 12:15:33.015652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 430/844] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:15:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:15:33.027219 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5129e190-5e1e-4a95-a687-f59330b33fca tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:33.027862 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5129e190-5e1e-4a95-a687-f59330b33fca tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:33.083813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5129e190-5e1e-4a95-a687-f59330b33fca tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:33.090713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5129e190-5e1e-4a95-a687-f59330b33fca tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1241 microversion: 2.1 time: 0.068093 Aug 30 12:15:33.091279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 415/845] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:33 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:33.480661 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:33.481147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:33.488201 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:33.488691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:33.489135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:33.489822 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:33.490281 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:33.490718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:33.504330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] HTTP exception thrown: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Request method failure captured: Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 HTTP/1.1 Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf3w_fO86aHLQ0Ek6v8HP_HA_q9cj_WeOkMwOsPhF-jQjwN0wfbtOqvHSJxkoe09edbOYJwqbl7sbOHxY8vf0nLvu14JhuO5JIZchkv2xqY-s431Mdsx40t0iSHytHTIX44wac1ez6kZpPOi-oNqu48QQLxysIwll1mj80hWa_ZwGFI Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:15:33.505889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 04a0c4a52ae34e71bda4903c305b58a4 Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.507501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '17fac3ff-6458-4118-994c-d9eebd1b8a30'} Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:33.508552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.510013 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.511246 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Returning 404 to user: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:33.511246 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bf943d3c-5ddc-4efb-841b-b9493aa2792c tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 404 len: 111 microversion: 2.1 time: 0.031201 Aug 30 12:15:33.511246 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 431/846] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:15:33 2022] DELETE /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:15:33.516548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:33.518286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] [instance: 17fac3ff-6458-4118-994c-d9eebd1b8a30] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:33.523033 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:33.524267 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:33.524700 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:33.525381 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:33.525830 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:33.526251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:33.539750 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] HTTP exception thrown: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Request method failure captured: Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 HTTP/1.1 Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf3w_fO86aHLQ0Ek6v8HP_HA_q9cj_WeOkMwOsPhF-jQjwN0wfbtOqvHSJxkoe09edbOYJwqbl7sbOHxY8vf0nLvu14JhuO5JIZchkv2xqY-s431Mdsx40t0iSHytHTIX44wac1ez6kZpPOi-oNqu48QQLxysIwll1mj80hWa_ZwGFI Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:15:33.541224 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/56e118000fea4e5e91d716d7612bb9e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 56e118000fea4e5e91d716d7612bb9e3 Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeTestJSON-456255611 Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 04a0c4a52ae34e71bda4903c305b58a4 Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeTestJSON-456255611-project Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.542841 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '17fac3ff-6458-4118-994c-d9eebd1b8a30'} Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:33.543838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. Aug 30 12:15:33.545337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:15:33.546729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] Returning 404 to user: Instance 17fac3ff-6458-4118-994c-d9eebd1b8a30 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:33.546729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-75424f7b-e2c7-4872-bef1-48a410d566e6 tempest-AttachVolumeTestJSON-456255611 tempest-AttachVolumeTestJSON-456255611-project] 10.222.0.42 "GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30" status: 404 len: 111 microversion: 2.1 time: 0.029893 Aug 30 12:15:33.546729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 416/847] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:33 2022] GET /compute/v2.1/servers/17fac3ff-6458-4118-994c-d9eebd1b8a30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:15:34.112717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:34.113394 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:34.119524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:34.120388 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:34.121616 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:34.122333 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:34.122794 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:34.123221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:34.199998 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:34.208692 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-667a3048-ea44-45a4-8768-81dc351a4774 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1245 microversion: 2.1 time: 0.099623 Aug 30 12:15:34.209348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 432/848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:34 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:35.232593 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:35.233773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:35.241500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:35.241995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:35.243140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:35.243919 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:35.244446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:35.244938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:35.348664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:35.356962 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bbe0d628-33bd-4c5a-a405-5db0a3aa23f1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1293 microversion: 2.1 time: 0.130562 Aug 30 12:15:35.360437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 417/849] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:35 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:15:36.378807 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:36.379826 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:36.389850 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:36.399334 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:36.401197 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:36.402129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:36.402767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:36.404272 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:36.657205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:36.665916 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6961ae45-7b5e-45c9-a5b3-969cb159e913 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.290963 Aug 30 12:15:36.666653 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 433/850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:36 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:37.303209 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-5b34ee64-c6a8-4f86-af61-cdae5849929c req-29a0ec3b-b88a-45aa-be1a-dcb3dcf6b799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ac18f1-5916-427c-afdf-a5c3bd612067", "tag": "7451aacd-101c-4f0a-b6c0-344d5ed44132"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:37.314715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-5b34ee64-c6a8-4f86-af61-cdae5849929c req-29a0ec3b-b88a-45aa-be1a-dcb3dcf6b799 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:37.315194 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-5b34ee64-c6a8-4f86-af61-cdae5849929c req-29a0ec3b-b88a-45aa-be1a-dcb3dcf6b799 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:37.315826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-5b34ee64-c6a8-4f86-af61-cdae5849929c req-29a0ec3b-b88a-45aa-be1a-dcb3dcf6b799 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:37.328188 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-5b34ee64-c6a8-4f86-af61-cdae5849929c req-29a0ec3b-b88a-45aa-be1a-dcb3dcf6b799 service nova] Creating event network-changed:7451aacd-101c-4f0a-b6c0-344d5ed44132 for instance c4ac18f1-5916-427c-afdf-a5c3bd612067 on hv-cinder-83976 Aug 30 12:15:37.333429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-5b34ee64-c6a8-4f86-af61-cdae5849929c req-29a0ec3b-b88a-45aa-be1a-dcb3dcf6b799 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033813 Aug 30 12:15:37.334038 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 418/851] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:37.688227 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:37.688839 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:37.695856 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:37.697221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:37.698453 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:37.698453 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:37.698811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:37.699237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:38.026715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:38.040682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7ddc2d68-2990-4836-bf8a-5f753a8e4dd7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.356489 Aug 30 12:15:38.042176 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 434/852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:37 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:39.062918 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:39.063625 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:39.069810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:39.070551 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:39.071516 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:39.072250 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:39.072874 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:39.073486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:39.214000 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:39.223393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d705d0af-97cb-4035-9eef-d908a080f43a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.163212 Aug 30 12:15:39.223393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 419/853] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:39 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:40.242694 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:40.243511 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:40.251389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:40.251972 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:40.252490 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:40.253739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:40.254273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:40.254960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:40.399555 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:40.408058 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-48029a92-032d-4d46-a786-9b0f80994962 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.169212 Aug 30 12:15:40.408972 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 435/854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:40 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:41.429338 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:41.430411 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:41.436454 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:41.437086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:41.437364 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:41.438062 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:41.438558 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:41.438925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:41.575783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:41.584243 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a95bd034-e633-40e2-89a5-77bbead4a352 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.158729 Aug 30 12:15:41.584805 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 420/855] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:41 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:42.405685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5f433d2f-9715-4a0f-8783-25774b552008 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4ef2ce50>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:42.458743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5f433d2f-9715-4a0f-8783-25774b552008 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4e746d57-9e57-4d80-9bd4-597b1bd24b85" status: 200 len: 351 microversion: 2.1 time: 0.056786 Aug 30 12:15:42.459323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 436/856] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:15:42 2022] GET /compute/v2.1/os-volumes/4e746d57-9e57-4d80-9bd4-597b1bd24b85 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:42.605889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:42.607055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:42.613430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:42.614013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:42.614469 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:42.615201 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:42.615655 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:42.616106 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:42.621909 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:42.759602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:42.767135 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cbc95026-9008-4616-b738-c240b96bfe49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.165592 Aug 30 12:15:42.767706 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 421/857] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:42 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:43.786086 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:43.786845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:43.791336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:43.791972 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:43.798885 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:43.799366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:43.799802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:43.800518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:43.800973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:43.801397 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:43.932089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:43.939863 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e57dccb4-23fd-4edc-b2b1-2b249e7a2c67 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.154521 Aug 30 12:15:43.940561 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 437/858] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:43 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:15:44.215271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5ae1d8bd-43ec-414e-bd74-a39dde8725be tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4ede5ca0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:44.221847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=6 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:44.268681 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5ae1d8bd-43ec-414e-bd74-a39dde8725be tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7e58a5a2-e31c-48b9-9489-d43089584a55" status: 200 len: 350 microversion: 2.1 time: 0.058251 Aug 30 12:15:44.269450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 422/859] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:15:44 2022] GET /compute/v2.1/os-volumes/7e58a5a2-e31c-48b9-9489-d43089584a55 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:44.472063 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-0e0214c7-6a30-44ef-abf3-567b0b75632d req-ba9d6070-aafd-45fc-9498-59e393d6c40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ac18f1-5916-427c-afdf-a5c3bd612067", "name": "network-vif-plugged", "status": "completed", "tag": "7451aacd-101c-4f0a-b6c0-344d5ed44132"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:44.483311 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-0e0214c7-6a30-44ef-abf3-567b0b75632d req-ba9d6070-aafd-45fc-9498-59e393d6c40e service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:44.483787 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-0e0214c7-6a30-44ef-abf3-567b0b75632d req-ba9d6070-aafd-45fc-9498-59e393d6c40e service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:44.484239 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-0e0214c7-6a30-44ef-abf3-567b0b75632d req-ba9d6070-aafd-45fc-9498-59e393d6c40e service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:44.495616 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-0e0214c7-6a30-44ef-abf3-567b0b75632d req-ba9d6070-aafd-45fc-9498-59e393d6c40e service nova] Creating event network-vif-plugged:7451aacd-101c-4f0a-b6c0-344d5ed44132 for instance c4ac18f1-5916-427c-afdf-a5c3bd612067 on hv-cinder-83976 Aug 30 12:15:44.501031 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-0e0214c7-6a30-44ef-abf3-567b0b75632d req-ba9d6070-aafd-45fc-9498-59e393d6c40e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032882 Aug 30 12:15:44.501633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 438/860] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:44.962430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:44.963078 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:44.969823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:44.970316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:44.970756 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:44.971448 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:44.971907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:44.972363 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:45.113644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:45.121974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8d276e22-d311-4618-8723-11db6c4c7c72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1367 microversion: 2.1 time: 0.164496 Aug 30 12:15:45.126318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 423/861] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:44 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:45.996640 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-29a37773-e818-4563-b597-41ecd44b2c78 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4ef2c790>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.045815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-29a37773-e818-4563-b597-41ecd44b2c78 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b9c19993-acbd-4720-8e2f-79c9fd924852" status: 200 len: 350 microversion: 2.1 time: 0.052875 Aug 30 12:15:46.045815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 439/862] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Aug 30 12:15:45 2022] GET /compute/v2.1/os-volumes/b9c19993-acbd-4720-8e2f-79c9fd924852 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:46.057719 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d403eb54-7a8a-423c-85b8-9c3f96084649 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4ee5a310>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.143167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.144330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:46.146454 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d403eb54-7a8a-423c-85b8-9c3f96084649 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093090 Aug 30 12:15:46.147448 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 424/863] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:46.151935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:46.152506 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:46.152948 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:46.153639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:46.154092 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:46.154515 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:46.159729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:46.162983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-04efed85-71ef-4828-89b5-81e165780a02 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4eed2b80>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.254095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-04efed85-71ef-4828-89b5-81e165780a02 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095992 Aug 30 12:15:46.254666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 425/864] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:46.268161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-215dfd06-3711-4f94-9033-de3b2390a434 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4edf3160>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.296024 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:46.303706 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-9722927c-634e-4673-9964-7468908c15f4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1558 microversion: 2.1 time: 0.164616 Aug 30 12:15:46.304441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 440/865] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:46.325948 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.326523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:46.332596 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:46.333152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:46.333852 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:46.334544 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:46.335090 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:46.335525 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:46.357530 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-215dfd06-3711-4f94-9033-de3b2390a434 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092712 Aug 30 12:15:46.358103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 426/866] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:15:46.370339 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b2997b4f-1212-48ef-9070-16e1da0c6b01 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4ede5940>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.428147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c0775d46-ed1b-4200-bba0-57eaa20b8d8f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106356 Aug 30 12:15:46.435417 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 441/867] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:15:46.463864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b2997b4f-1212-48ef-9070-16e1da0c6b01 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097118 Aug 30 12:15:46.464485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 427/868] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:15:46.478175 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f4400766-2646-4cb5-9f0a-18964669ddd0 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4ee0e280>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.568587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f4400766-2646-4cb5-9f0a-18964669ddd0 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094640 Aug 30 12:15:46.569196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 442/869] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:46.582081 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e572e0c8-63e7-4629-9f34-3807aa1460f0 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4edcd9d0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.667073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e572e0c8-63e7-4629-9f34-3807aa1460f0 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088643 Aug 30 12:15:46.671981 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 428/870] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:46.680700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-36844040-8abf-4264-9d41-757cda65be81 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4ef2c9d0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.765036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-36844040-8abf-4264-9d41-757cda65be81 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088243 Aug 30 12:15:46.765685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 443/871] 10.222.0.42 () {58 vars in 1188 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:15:46.779116 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f5daf58a-5ee7-4446-aca2-17a8be4a3781 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] Calling method '.version_select at 0x7efe4eddf0d0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:46.864515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f5daf58a-5ee7-4446-aca2-17a8be4a3781 tempest-VolumesTestJSON-1954165910 tempest-VolumesTestJSON-1954165910-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089132 Aug 30 12:15:46.865099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 429/872] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Aug 30 12:15:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:47.469140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-f752fde8-3035-4edd-acad-58246a8fc501 req-cde12d76-828c-4a18-a5b2-ecc0b40c57fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ac18f1-5916-427c-afdf-a5c3bd612067", "tag": "7451aacd-101c-4f0a-b6c0-344d5ed44132"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:47.480286 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-f752fde8-3035-4edd-acad-58246a8fc501 req-cde12d76-828c-4a18-a5b2-ecc0b40c57fa service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:47.482372 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-f752fde8-3035-4edd-acad-58246a8fc501 req-cde12d76-828c-4a18-a5b2-ecc0b40c57fa service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:47.482372 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-f752fde8-3035-4edd-acad-58246a8fc501 req-cde12d76-828c-4a18-a5b2-ecc0b40c57fa service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:47.491718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-f752fde8-3035-4edd-acad-58246a8fc501 req-cde12d76-828c-4a18-a5b2-ecc0b40c57fa service nova] Creating event network-changed:7451aacd-101c-4f0a-b6c0-344d5ed44132 for instance c4ac18f1-5916-427c-afdf-a5c3bd612067 on hv-cinder-83976 Aug 30 12:15:47.497561 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-f752fde8-3035-4edd-acad-58246a8fc501 req-cde12d76-828c-4a18-a5b2-ecc0b40c57fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032542 Aug 30 12:15:47.498159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 444/873] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:48.982610 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-780873986"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:48.983166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:48.989238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:48.989733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:48.990173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:48.990871 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:48.991620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:48.992182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:49.127193 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.network.security_group_api [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Removing security group e2a3d227-b835-4997-9505-9407ed73ad7f from port c119f48c-5cdc-4730-83b4-4520b61dc812 Aug 30 12:15:49.542574 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5396f011-34fb-4a42-a567-1336c5de726f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/action" status: 202 len: 0 microversion: 2.1 time: 0.564551 Aug 30 12:15:49.543178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 430/874] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:15:48 2022] POST /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:15:49.573486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-3e0dee0c-f597-4df3-802f-bd62705aa749 req-caebff39-b2ac-4484-9cb2-94c620309993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d3c7d0-1615-465b-9099-7ebed6b4f402", "tag": "c119f48c-5cdc-4730-83b4-4520b61dc812"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:49.592872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-3e0dee0c-f597-4df3-802f-bd62705aa749 req-caebff39-b2ac-4484-9cb2-94c620309993 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:49.593627 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-3e0dee0c-f597-4df3-802f-bd62705aa749 req-caebff39-b2ac-4484-9cb2-94c620309993 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:49.594077 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-3e0dee0c-f597-4df3-802f-bd62705aa749 req-caebff39-b2ac-4484-9cb2-94c620309993 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:49.627973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-3e0dee0c-f597-4df3-802f-bd62705aa749 req-caebff39-b2ac-4484-9cb2-94c620309993 service nova] Creating event network-changed:c119f48c-5cdc-4730-83b4-4520b61dc812 for instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 on hv-cinder-83976 Aug 30 12:15:49.640918 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-3e0dee0c-f597-4df3-802f-bd62705aa749 req-caebff39-b2ac-4484-9cb2-94c620309993 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073175 Aug 30 12:15:49.644543 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 445/875] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:51.077216 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:51.077737 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:51.084155 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:51.084650 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:51.085090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:51.085789 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:51.087097 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:51.087644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:51.182555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lazy-loading 'services' on Instance uuid 56d3c7d0-1615-465b-9099-7ebed6b4f402 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:15:51.406636 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dc153846-a1bd-4d17-aa3f-5dc50194d4d3 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments/abab7ee1-9c7f-4a7a-b770-f478660b9e91" status: 202 len: 0 microversion: 2.1 time: 0.332711 Aug 30 12:15:51.408973 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 431/876] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:15:51 2022] DELETE /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments/abab7ee1-9c7f-4a7a-b770-f478660b9e91 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:15:51.424862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:51.433891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:51.445163 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:51.446845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:51.447402 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:51.448269 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:51.448978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:51.449699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:51.495902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8b11b8d6-70c6-4cc1-b35b-41beca6056c6 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079801 Aug 30 12:15:51.497663 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 446/877] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:51 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:51.656746 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-0642f3fe-f412-4e33-999f-157c7f378e7f req-9d28817b-9ccf-4aff-be01-b8b4d9362e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d3c7d0-1615-465b-9099-7ebed6b4f402", "tag": "c119f48c-5cdc-4730-83b4-4520b61dc812"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:51.667138 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0642f3fe-f412-4e33-999f-157c7f378e7f req-9d28817b-9ccf-4aff-be01-b8b4d9362e11 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:51.668032 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0642f3fe-f412-4e33-999f-157c7f378e7f req-9d28817b-9ccf-4aff-be01-b8b4d9362e11 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:51.668554 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-0642f3fe-f412-4e33-999f-157c7f378e7f req-9d28817b-9ccf-4aff-be01-b8b4d9362e11 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:51.701335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-0642f3fe-f412-4e33-999f-157c7f378e7f req-9d28817b-9ccf-4aff-be01-b8b4d9362e11 service nova] Creating event network-changed:c119f48c-5cdc-4730-83b4-4520b61dc812 for instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 on hv-cinder-83976 Aug 30 12:15:51.715256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-0642f3fe-f412-4e33-999f-157c7f378e7f req-9d28817b-9ccf-4aff-be01-b8b4d9362e11 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061796 Aug 30 12:15:51.716388 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 432/878] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:15:52.516434 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:52.516434 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:52.520450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:52.521002 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:52.521358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:52.522058 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:52.522506 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:52.522931 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:52.572402 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7e696832-222e-4fbc-8dd9-c0793cc9cd71 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065595 Aug 30 12:15:52.572995 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 447/879] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:52 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:15:53.589838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:53.591652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:53.594568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:53.603231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:53.603970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:53.604417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:53.605479 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:53.605945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:53.606374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:53.653693 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f5ddddd1-4af8-44ef-8352-4d80b5b71207 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072470 Aug 30 12:15:53.654602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 433/880] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:15:53 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:15:53.665338 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:53.666577 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:53.669310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:15:53.674615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:53.675290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:53.675902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:53.676803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:53.677593 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:53.678331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:53.704776 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-137943061", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "networks": [{"uuid": "ecfe3e8d-a172-45bc-a9fe-2e88fa36b606"}]}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:15:53.767268 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] validate_networks() for [('ecfe3e8d-a172-45bc-a9fe-2e88fa36b606', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:15:53.768885 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] HTTP exception thrown: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 is not attached to volume abab7ee1-9c7f-4a7a-b770-f478660b9e91 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Request method failure captured: Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments/abab7ee1-9c7f-4a7a-b770-f478660b9e91 HTTP/1.1 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf7YzHvmqP-0EsW2qNGUi-76kJjGBvW8gdqq4JIXcmYy_WeP1OObCMW2Zz4oGhG8IJdtEFT-zMWgsw_W_Osxd4DncE4sW4D8Tm6c44lCyDv-WabCGPP3Px_YL2glYsS2q4NhOFJHS-4kLvZPd6A08HON0wvRGy93qBs9TUt3uK0R2s8 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 66ad307771aa4815a2c5d81606f60ba8 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-TestMinimumBasicScenario-592184952 Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:15:53.772665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-TestMinimumBasicScenario-592184952 Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 66ad307771aa4815a2c5d81606f60ba8 Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-TestMinimumBasicScenario-592184952 Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-TestMinimumBasicScenario-592184952-project Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 7bb9322155fc48108ffb2c52b1f684b6 Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-TestMinimumBasicScenario-592184952-project Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:15:53.775431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 is not attached to volume abab7ee1-9c7f-4a7a-b770-f478660b9e91 Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'server_id': '56d3c7d0-1615-465b-9099-7ebed6b4f402', 'id': 'abab7ee1-9c7f-4a7a-b770-f478660b9e91'} Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id abab7ee1-9c7f-4a7a-b770-f478660b9e91. Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:15:53.776380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 is not attached to volume abab7ee1-9c7f-4a7a-b770-f478660b9e91 Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 is not attached to volume abab7ee1-9c7f-4a7a-b770-f478660b9e91 Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:15:53.777724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Returning 404 to user: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 is not attached to volume abab7ee1-9c7f-4a7a-b770-f478660b9e91 {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:15:53.778698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4f2c2cfd-7979-4ec5-82b4-49205218e58f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments/abab7ee1-9c7f-4a7a-b770-f478660b9e91" status: 404 len: 154 microversion: 2.1 time: 0.114783 Aug 30 12:15:53.778698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 448/881] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:15:53 2022] DELETE /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402/os-volume_attachments/abab7ee1-9c7f-4a7a-b770-f478660b9e91 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:15:54.580131 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:15:54.580584 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:15:54.581052 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:15:54.581456 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:15:54.581864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:15:54.591154 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:54.592057 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:54.592500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:54.593653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:54.593758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:54.594098 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:54.612397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Getting quotas for project e379bccda6e44614b0b19f2552195939. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:15:54.616466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Getting quotas for user 417e43f1e4e548aab3988b32fa36dafa and project e379bccda6e44614b0b19f2552195939. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:15:54.628894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:15:54.631298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:15:54.743416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-04f91a8f-7bce-470e-88c0-9eec649624dd tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041425 Aug 30 12:15:54.744547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 434/882] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 12:15:54.759290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c81e1ff2-db19-4f0f-b7a2-73ec4286b3f6 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:54.759925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c81e1ff2-db19-4f0f-b7a2-73ec4286b3f6 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:54.826580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c81e1ff2-db19-4f0f-b7a2-73ec4286b3f6 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:54.847707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c81e1ff2-db19-4f0f-b7a2-73ec4286b3f6 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1213 microversion: 2.1 time: 0.093826 Aug 30 12:15:54.848316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 449/883] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:54 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:15:55.106794 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:55.107023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:55.113453 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:55.113941 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:55.114380 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:55.115262 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:55.115719 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:55.116191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:55.142737 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:15:55.544803 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0e126d4e-20c4-4be1-813d-8fe83e832116 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 204 len: 0 microversion: 2.1 time: 0.443311 Aug 30 12:15:55.545382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 435/884] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:15:55 2022] DELETE /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:15:55.553496 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:55.554100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:55.560637 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:55.561166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:55.561596 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:55.562279 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:55.562731 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:55.563149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:55.700991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:55.708785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-386e9815-b206-4b82-9ddf-fb03f12834a8 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1553 microversion: 2.1 time: 0.159161 Aug 30 12:15:55.709347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 450/885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:55 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:55.870501 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4790832a-df4c-4d06-989a-9044d774fdca tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:55.871123 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4790832a-df4c-4d06-989a-9044d774fdca tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:55.924896 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4790832a-df4c-4d06-989a-9044d774fdca tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:55.933314 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4790832a-df4c-4d06-989a-9044d774fdca tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1213 microversion: 2.1 time: 0.067866 Aug 30 12:15:55.933871 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 436/886] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:55 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:56.730295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:56.730952 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:56.737760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:56.741504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:56.741504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:56.741504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:56.741504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:56.741904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:56.954383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:56.959663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:56.971908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:56.973565 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:56.974126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:56.974661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:56.975529 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:56.976031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:56.976451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:56.980305 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-90805140-e207-4776-aa57-8b380463bef7 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1553 microversion: 2.1 time: 0.254358 Aug 30 12:15:56.980880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 451/887] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:56 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:57.047574 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:57.055683 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c20c474b-6f7b-4e46-bbda-67f5a92ae47e tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1217 microversion: 2.1 time: 0.105012 Aug 30 12:15:57.056290 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 437/888] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:56 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:15:58.008635 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:58.009403 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:58.015558 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:58.016069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:58.016504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:58.017196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:58.017647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:58.018089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:58.078012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:58.078624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:58.084982 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:58.085464 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:58.085898 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:58.087585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:58.088077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:58.088508 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:58.152397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:58.160804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9a0b79e7-ddee-4ff4-9a33-851e7b807d1f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1217 microversion: 2.1 time: 0.086449 Aug 30 12:15:58.161443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 438/889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:58 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:58.244277 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:58.252419 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8297cad7-200f-4aae-9e90-d456c564c33f tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1553 microversion: 2.1 time: 0.248383 Aug 30 12:15:58.253237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 452/890] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:58 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:59.182237 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:59.183765 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:59.191494 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:59.192226 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:59.194892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:59.194892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:59.194892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:59.194892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:59.260486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:59.268052 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6d3a303c-5f9a-491f-919e-84a945643c07 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1217 microversion: 2.1 time: 0.089928 Aug 30 12:15:59.268612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 439/891] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:59 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:15:59.274537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:15:59.281183 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:15:59.281649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:59.282119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:59.282577 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:59.283263 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:15:59.283717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:15:59.284178 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:15:59.418417 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:15:59.426167 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1ceadf15-9752-424a-b990-bc354053b0ca tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1553 microversion: 2.1 time: 0.155537 Aug 30 12:15:59.426749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 453/892] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:15:59 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:00.291418 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:00.293373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:00.306260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:00.307077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:00.307783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:00.308701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:00.309161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:00.311802 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:00.382550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:00.395007 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-da2633e0-d702-4b31-a7c8-55b54410a16d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1265 microversion: 2.1 time: 0.108353 Aug 30 12:16:00.396120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 440/893] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:00 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:00.449069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:00.472109 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:00.484086 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:00.484086 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:00.484086 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:00.484086 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:00.484579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:00.484855 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:00.513874 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-b0079319-ca93-4106-b3e8-04004305b934 req-ac4301fc-4b7d-4974-992f-b42827f82b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d3c7d0-1615-465b-9099-7ebed6b4f402", "name": "network-vif-deleted", "tag": "c119f48c-5cdc-4730-83b4-4520b61dc812"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:00.527098 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-b0079319-ca93-4106-b3e8-04004305b934 req-ac4301fc-4b7d-4974-992f-b42827f82b62 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:00.527586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-b0079319-ca93-4106-b3e8-04004305b934 req-ac4301fc-4b7d-4974-992f-b42827f82b62 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:00.528045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-b0079319-ca93-4106-b3e8-04004305b934 req-ac4301fc-4b7d-4974-992f-b42827f82b62 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:00.541121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-b0079319-ca93-4106-b3e8-04004305b934 req-ac4301fc-4b7d-4974-992f-b42827f82b62 service nova] Creating event network-vif-deleted:c119f48c-5cdc-4730-83b4-4520b61dc812 for instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 on hv-cinder-83976 Aug 30 12:16:00.548688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-b0079319-ca93-4106-b3e8-04004305b934 req-ac4301fc-4b7d-4974-992f-b42827f82b62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038586 Aug 30 12:16:00.549487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 441/894] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:16:00.563571 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:00.573232 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3c09d7cc-34d8-4b40-938e-1b06f75a1528 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1511 microversion: 2.1 time: 0.129979 Aug 30 12:16:00.573835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 454/895] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:00 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1511 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:01.419217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:01.420552 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:01.427211 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:01.428231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:01.428666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:01.429562 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:01.430252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:01.430859 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:01.515724 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:01.524302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d273e3ed-a1f0-4c01-a2ff-9665c7cd0c38 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1273 microversion: 2.1 time: 0.110458 Aug 30 12:16:01.525236 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 442/896] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:01 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:01.595695 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:01.596422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:01.604439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:01.608038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:01.608038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:01.608038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:01.608038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:01.608643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:01.646144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:01.646759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:01.647295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:01.647841 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lazy-loading 'fault' on Instance uuid 56d3c7d0-1615-465b-9099-7ebed6b4f402 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:16:01.696530 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:01.704832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a8d3a443-6cfa-4d63-bc74-afbcae03385e tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1347 microversion: 2.1 time: 0.112905 Aug 30 12:16:01.705781 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 455/897] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:01 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1347 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:02.545500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:02.546180 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:02.553106 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:02.553806 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:02.554393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:02.556095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:02.556703 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:02.557852 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:02.704549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:02.717047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9acb3ffe-41df-444e-9926-d42292728f45 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.175231 Aug 30 12:16:02.717627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 443/898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:02 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:02.731077 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:02.731586 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:02.738454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:02.739151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:02.739759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:02.740535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:02.740991 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:02.741599 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:02.775696 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:02.776487 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:02.776930 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:02.777390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lazy-loading 'fault' on Instance uuid 56d3c7d0-1615-465b-9099-7ebed6b4f402 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:16:02.836799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb9322155fc48108ffb2c52b1f684b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ad307771aa4815a2c5d81606f60ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:02.844198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4bb546b4-748e-4f65-8f05-1e08643fc469 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 200 len: 1347 microversion: 2.1 time: 0.117665 Aug 30 12:16:02.844765 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 456/899] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:02 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 1347 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:03.107175 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-717249905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1243030642", "security_groups": [{"name": "tempest-secgroup-smoke-275745598"}], "block_device_mapping_v2": [{"uuid": "cd8dc79f-c662-402e-b168-83d3c0520e4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4ba54cfd-b283-4e2b-b07e-a4cb404d43be"}]}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:03.229112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] validate_networks() for [('4ba54cfd-b283-4e2b-b07e-a4cb404d43be', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:16:03.294529 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-5e834870-b4d7-4885-a96f-7fef1adf8ca5 req-fc27b5cb-8143-4d76-b661-7a4137c6aac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1379861-8927-4ad9-8037-b8661b257ccd", "tag": "955c2d16-52cc-49e4-99a3-f44f9c335ffe"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:03.304634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-5e834870-b4d7-4885-a96f-7fef1adf8ca5 req-fc27b5cb-8143-4d76-b661-7a4137c6aac2 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:03.305460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-5e834870-b4d7-4885-a96f-7fef1adf8ca5 req-fc27b5cb-8143-4d76-b661-7a4137c6aac2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:03.305897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-5e834870-b4d7-4885-a96f-7fef1adf8ca5 req-fc27b5cb-8143-4d76-b661-7a4137c6aac2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:03.319763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-5e834870-b4d7-4885-a96f-7fef1adf8ca5 req-fc27b5cb-8143-4d76-b661-7a4137c6aac2 service nova] Creating event network-changed:955c2d16-52cc-49e4-99a3-f44f9c335ffe for instance f1379861-8927-4ad9-8037-b8661b257ccd on hv-cinder-83976 Aug 30 12:16:03.326927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-5e834870-b4d7-4885-a96f-7fef1adf8ca5 req-fc27b5cb-8143-4d76-b661-7a4137c6aac2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037905 Aug 30 12:16:03.329273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 457/900] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:16:03.647048 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:16:03.647605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:16:03.648053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:16:03.649035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:16:03.649482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:16:03.658649 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:03.659128 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:03.659749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:03.660514 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:03.660972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:03.661484 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:03.679006 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:16:03.684003 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Getting quotas for user 3733f8f0d14746949cbe92c9d370c33e and project cec4d079d6524a0db40e8a055fbd4d9c. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:16:03.739990 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:03.740710 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:03.744669 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:16:03.746779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd8dc79f-c662-402e-b168-83d3c0520e4d',volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:16:03.757104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:03.757104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:03.757104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:03.762799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:03.763268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:03.763698 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:03.981658 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:03.991206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-596a0bae-f71e-4303-9836-9a2ceec85a34 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.255904 Aug 30 12:16:03.992999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 458/901] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:03 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:03.999405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:04.000446 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] [instance: 56d3c7d0-1615-465b-9099-7ebed6b4f402] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:04.007044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:04.007625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:04.009008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:04.010198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:04.011000 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:04.011785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:04.028211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] HTTP exception thrown: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 could not be found. Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Request method failure captured: Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 HTTP/1.1 Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf7YzHvmqP-0EsW2qNGUi-76kJjGBvW8gdqq4JIXcmYy_WeP1OObCMW2Zz4oGhG8IJdtEFT-zMWgsw_W_Osxd4DncE4sW4D8Tm6c44lCyDv-WabCGPP3Px_YL2glYsS2q4NhOFJHS-4kLvZPd6A08HON0wvRGy93qBs9TUt3uK0R2s8 Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 66ad307771aa4815a2c5d81606f60ba8 Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-TestMinimumBasicScenario-592184952 Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:16:04.029868 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66ad307771aa4815a2c5d81606f60ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-TestMinimumBasicScenario-592184952 Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 66ad307771aa4815a2c5d81606f60ba8 Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-TestMinimumBasicScenario-592184952 Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-TestMinimumBasicScenario-592184952-project Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 7bb9322155fc48108ffb2c52b1f684b6 Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-TestMinimumBasicScenario-592184952-project Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 could not be found. Aug 30 12:16:04.031499 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '56d3c7d0-1615-465b-9099-7ebed6b4f402'} Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 could not be found. Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:16:04.033466 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 could not be found. Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 could not be found. Aug 30 12:16:04.034849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:04.036182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Returning 404 to user: Instance 56d3c7d0-1615-465b-9099-7ebed6b4f402 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:16:04.036182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-91e02fbe-a434-4717-bc5f-9e6a11d35144 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402" status: 404 len: 111 microversion: 2.1 time: 0.036051 Aug 30 12:16:04.036182 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 459/902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:03 2022] GET /compute/v2.1/servers/56d3c7d0-1615-465b-9099-7ebed6b4f402 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:16:04.040745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cba4adcf-3fa7-4ec6-8f0f-fca2a2302e57 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] Calling method '.version_select at 0x7efe4ec60a60>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:04.134717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cba4adcf-3fa7-4ec6-8f0f-fca2a2302e57 tempest-TestMinimumBasicScenario-592184952 tempest-TestMinimumBasicScenario-592184952-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-492312201" status: 202 len: 0 microversion: 2.1 time: 0.098349 Aug 30 12:16:04.135433 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 460/903] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Aug 30 12:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-492312201 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:16:04.295252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1c02b74e-bb20-4a27-aaba-89dbd176c673 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.193164 Aug 30 12:16:04.295903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 444/904] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:16:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:16:04.307299 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a65c20fd-6738-4782-b5c7-177264660194 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:04.308019 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a65c20fd-6738-4782-b5c7-177264660194 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:04.362826 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a65c20fd-6738-4782-b5c7-177264660194 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:04.372092 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a65c20fd-6738-4782-b5c7-177264660194 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1094 microversion: 2.1 time: 0.069252 Aug 30 12:16:04.372830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 461/905] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:04 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:05.015487 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:05.016149 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:05.022317 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:05.027747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:05.027747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:05.027747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:05.027747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:05.028505 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:05.166077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:05.175441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-112a869c-78fb-4414-bf94-1c865e62be7a tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.164287 Aug 30 12:16:05.176023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 445/906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:05 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:05.394337 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:05.395575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:05.404175 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:05.404673 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:05.405106 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:05.405801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:05.412365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:05.412818 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:05.481213 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:05.490603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b849d2db-1e4e-48cf-92a7-c601921c597e tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1144 microversion: 2.1 time: 0.101166 Aug 30 12:16:05.491166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 462/907] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:05 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:06.197669 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:06.198878 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:06.205609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:06.206112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:06.206550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:06.207249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:06.207708 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:06.208178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:06.231498 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:06.349328 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:06.357336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fdf380e5-c1c4-4958-8e79-c9feb9e14425 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.164751 Aug 30 12:16:06.358395 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 446/908] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:06 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:06.513844 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:06.514675 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:06.522501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:06.523105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:06.523611 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:06.524418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:06.524956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:06.525454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:06.798090 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:06.806318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-850f5f8d-baea-4717-90b8-2b6944fbcf3b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1192 microversion: 2.1 time: 0.297064 Aug 30 12:16:06.806906 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 463/909] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:06 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1192 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:07.378881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:07.379491 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:07.388480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:07.389234 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:07.389842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:07.390697 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:07.391302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:07.391895 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:07.540298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:07.548427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c222372a-a466-4770-88fc-a1ff05f85e19 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.173501 Aug 30 12:16:07.549013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 447/910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:07 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:07.826828 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:07.828644 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:07.837645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:07.839181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:07.841711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:07.842787 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:07.843455 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:07.844532 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:07.858133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:07.996447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:08.004468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f2c71e41-e3bc-4ed4-829c-768e8346d7b7 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1210 microversion: 2.1 time: 0.181512 Aug 30 12:16:08.006044 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 464/911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:07 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:08.571406 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:08.572735 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:08.583605 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:08.584954 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:08.586086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:08.587740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:08.588927 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:08.589540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:08.829414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:08.837826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6b7ffe64-5a2a-47ad-b231-a4dbd8fbf734 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.271746 Aug 30 12:16:08.838742 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 448/912] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:08 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:09.026665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:09.028058 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:09.049554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:09.050377 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:09.051368 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:09.053127 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:09.056264 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:09.064541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:09.488598 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:09.498377 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c079d504-8479-48b8-871e-3803dc1f289a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1277 microversion: 2.1 time: 0.476583 Aug 30 12:16:09.513657 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 465/913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:09 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1277 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:09.862420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:09.863300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:09.871190 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:09.871688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:09.872160 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:09.872908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:09.873356 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:09.873783 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:10.014045 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:10.021787 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-36a60d0f-9733-4718-b4e1-dfb37dd4dec1 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.163912 Aug 30 12:16:10.022531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 449/914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:09 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:10.293768 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-14aa2977-20fd-46d9-ba97-f46ab0d05261 req-328282dd-407e-44e7-aa34-d48a5a215a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4a2abc-6f16-4ada-9c90-059d88bac50f", "tag": "f7343819-b8c6-453c-a9a4-b895882763d1"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:10.309347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-14aa2977-20fd-46d9-ba97-f46ab0d05261 req-328282dd-407e-44e7-aa34-d48a5a215a2b service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:10.309829 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-14aa2977-20fd-46d9-ba97-f46ab0d05261 req-328282dd-407e-44e7-aa34-d48a5a215a2b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:10.310467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-14aa2977-20fd-46d9-ba97-f46ab0d05261 req-328282dd-407e-44e7-aa34-d48a5a215a2b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:10.322627 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-14aa2977-20fd-46d9-ba97-f46ab0d05261 req-328282dd-407e-44e7-aa34-d48a5a215a2b service nova] Creating event network-changed:f7343819-b8c6-453c-a9a4-b895882763d1 for instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f on hv-cinder-83976 Aug 30 12:16:10.328148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-14aa2977-20fd-46d9-ba97-f46ab0d05261 req-328282dd-407e-44e7-aa34-d48a5a215a2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038585 Aug 30 12:16:10.329653 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 466/915] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:10.524403 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:10.525578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:10.532030 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:10.532715 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:10.533417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:10.534839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:10.535460 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:10.536135 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:10.753329 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:10.764942 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f8558290-a3bd-46cd-85f4-4609275da486 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.247686 Aug 30 12:16:10.767253 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-be7a8897-f483-4033-bf86-f6c7d04def00 req-01e6830b-c177-410a-88eb-e0a28789168d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1379861-8927-4ad9-8037-b8661b257ccd", "name": "network-vif-plugged", "status": "completed", "tag": "955c2d16-52cc-49e4-99a3-f44f9c335ffe"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:10.778691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-be7a8897-f483-4033-bf86-f6c7d04def00 req-01e6830b-c177-410a-88eb-e0a28789168d service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:10.779527 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-be7a8897-f483-4033-bf86-f6c7d04def00 req-01e6830b-c177-410a-88eb-e0a28789168d service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:10.780209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-be7a8897-f483-4033-bf86-f6c7d04def00 req-01e6830b-c177-410a-88eb-e0a28789168d service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:10.780833 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 450/916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:10 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:10.793380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-be7a8897-f483-4033-bf86-f6c7d04def00 req-01e6830b-c177-410a-88eb-e0a28789168d service nova] Creating event network-vif-plugged:955c2d16-52cc-49e4-99a3-f44f9c335ffe for instance f1379861-8927-4ad9-8037-b8661b257ccd on hv-cinder-83976 Aug 30 12:16:10.798795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-be7a8897-f483-4033-bf86-f6c7d04def00 req-01e6830b-c177-410a-88eb-e0a28789168d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035831 Aug 30 12:16:10.800015 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 467/917] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:11.045278 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:11.045980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:11.061219 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:11.061713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:11.062154 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:11.063013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:11.063480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:11.065019 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:11.224773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:11.240817 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c87961ac-1740-4a1c-a5de-0aede411b4ed tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.195656 Aug 30 12:16:11.240817 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 451/918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:11 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:11.799189 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:11.799915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:11.809733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:11.810446 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:11.811032 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:11.811739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:11.812379 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:11.813096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:11.960925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:11.979890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-5c8a86c6-b377-4c30-864a-c19c5ce28ed4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.196548 Aug 30 12:16:11.980508 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 468/919] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:11 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:12.255778 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:12.256520 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:12.264309 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:12.264896 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:12.265331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:12.266228 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:12.266722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:12.267180 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:12.481929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:12.490851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3c18919b-4155-4dcf-9578-32f0bbb728f2 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1313 microversion: 2.1 time: 0.238893 Aug 30 12:16:12.491424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 452/920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:12 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:13.001352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:13.001999 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:13.009440 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:13.009931 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:13.010370 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:13.011196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:13.011647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:13.012103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:13.171238 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:13.179137 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-39ec507f-2a48-4504-94ee-007363aa65a3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.181812 Aug 30 12:16:13.180685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 469/921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:12 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:13.510978 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:13.511638 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:13.518975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:13.519463 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:13.520566 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:13.521283 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:13.521899 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:13.522476 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:13.669423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=4 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:13.691367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:13.693795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=14 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:13.701366 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8ffb0401-26ba-4e59-8e99-997a8eb1ce1d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1497 microversion: 2.1 time: 0.194094 Aug 30 12:16:13.716659 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 453/922] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:13 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:14.201347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:14.202121 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:14.208676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:14.209160 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:14.209956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:14.210516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:14.210972 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:14.212048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:14.367136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=4 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:14.472726 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:14.480581 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-751399bf-bf31-4c81-a15b-eab704dc55f3 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.283520 Aug 30 12:16:14.481156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 470/923] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:14 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:14.728755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:14.730375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:14.743623 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:14.744159 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:14.745100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:14.745587 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:14.746118 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:14.746615 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:14.789585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:16:15.156604 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-0c8eb41c-b7fd-4304-9159-9b5dcc79ac58 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 204 len: 0 microversion: 2.1 time: 0.432041 Aug 30 12:16:15.165423 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 454/924] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:16:14 2022] DELETE /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:16:15.167165 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:15.167784 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:15.174412 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:15.175173 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:15.175818 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:15.177192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:15.177877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:15.178504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:15.360151 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:15.369262 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-81614968-bb33-47f7-9339-6f233aad6657 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1503 microversion: 2.1 time: 0.206145 Aug 30 12:16:15.369825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 471/925] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:15 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:15.505680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:15.507135 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:15.515111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:15.515599 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:15.516057 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:15.516764 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:15.517222 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:15.517653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:15.724904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:15.733657 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7a9aa5d4-e702-4105-ba09-755081865d49 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.234585 Aug 30 12:16:15.734971 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 455/926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:15 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:16.391654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:16.392931 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:16.401547 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:16.405219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:16.405219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:16.405219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:16.405219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:16.405566 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:16.547285 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:16.561645 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-23f43d8b-8568-426d-8a83-17ded50a1942 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1503 microversion: 2.1 time: 0.174439 Aug 30 12:16:16.565745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 472/927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:16 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:16.755699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:16.756334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:16.763305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:16.763789 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:16.764252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:16.764942 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:16.765459 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:16.765889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:16.911880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:16.918634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-22b2fcc2-028d-47d0-bcf8-24377466bde8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.166784 Aug 30 12:16:16.925638 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 456/928] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:16 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:17.468071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-81a41208-3a42-41da-bd42-240750431e12 req-3d24ac33-a331-446a-9b28-932986f0bef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1379861-8927-4ad9-8037-b8661b257ccd", "name": "network-vif-deleted", "tag": "955c2d16-52cc-49e4-99a3-f44f9c335ffe"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:17.481597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-81a41208-3a42-41da-bd42-240750431e12 req-3d24ac33-a331-446a-9b28-932986f0bef2 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:17.482199 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-81a41208-3a42-41da-bd42-240750431e12 req-3d24ac33-a331-446a-9b28-932986f0bef2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:17.483031 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-81a41208-3a42-41da-bd42-240750431e12 req-3d24ac33-a331-446a-9b28-932986f0bef2 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:17.495158 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-81a41208-3a42-41da-bd42-240750431e12 req-3d24ac33-a331-446a-9b28-932986f0bef2 service nova] Creating event network-vif-deleted:955c2d16-52cc-49e4-99a3-f44f9c335ffe for instance f1379861-8927-4ad9-8037-b8661b257ccd on hv-cinder-83976 Aug 30 12:16:17.500357 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-81a41208-3a42-41da-bd42-240750431e12 req-3d24ac33-a331-446a-9b28-932986f0bef2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036811 Aug 30 12:16:17.500960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 473/929] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:17.585222 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:17.585828 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:17.592995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:17.593485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:17.593964 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:17.594707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:17.595177 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:17.595596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:17.676986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:17.686588 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a3cbfb35-8bef-4f10-944b-0ad464d5d495 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1461 microversion: 2.1 time: 0.105285 Aug 30 12:16:17.687276 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 457/930] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:17 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1461 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:17.940987 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:17.941687 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:17.948835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:17.949320 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:17.954349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:17.954349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:17.954349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:17.954349 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:18.140345 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:18.148364 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e95527f6-3469-4159-bbbb-1e0eae0eab66 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.211563 Aug 30 12:16:18.149381 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 474/931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:17 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:18.707495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:18.708403 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:18.715546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:18.716071 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:18.716515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:18.717221 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:18.717713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:18.718140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:18.755535 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:18.756098 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:18.756534 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:18.756988 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lazy-loading 'fault' on Instance uuid f1379861-8927-4ad9-8037-b8661b257ccd {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:16:18.801999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:18.809883 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4d0d149f-dcdd-4801-8d63-ed64f5cb1397 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 200 len: 1303 microversion: 2.1 time: 0.106095 Aug 30 12:16:18.824065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 458/932] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:18 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:19.169856 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:19.170464 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:19.176896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:19.177373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:19.177808 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:19.178494 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:19.178951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:19.179373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:19.322243 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:19.330045 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b809fa55-d83c-4011-944b-4d53fdf96f89 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.164150 Aug 30 12:16:19.330616 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 475/933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:19 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:19.830866 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:19.831804 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: f1379861-8927-4ad9-8037-b8661b257ccd] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:19.838704 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:19.839200 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:19.839643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:19.840366 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:19.840825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:19.841252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:19.855267 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] HTTP exception thrown: Instance f1379861-8927-4ad9-8037-b8661b257ccd could not be found. Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Request method failure captured: Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd HTTP/1.1 Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf93xDLHSqmI6oFl_VftIRT0Cxep_PV6VqJ8OqtsiI-SuL6ySoA65wJ0d05x8jwxWbtIN0nJEhUqfRRhVVPl_cKJ-9MEe6d-q-dCMsoZ6Q7xkPGyhFWNmDEaoWsVDSbP9nXRk0Hb29pAZCcIGSDVxXJ_jNGo3BchdMgxH1hmMoRXYDM Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: e379bccda6e44614b0b19f2552195939 Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesActionsTest-512244481 Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:16:19.856903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e379bccda6e44614b0b19f2552195939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e379bccda6e44614b0b19f2552195939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e379bccda6e44614b0b19f2552195939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e379bccda6e44614b0b19f2552195939"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesActionsTest-512244481 Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: e379bccda6e44614b0b19f2552195939 Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesActionsTest-512244481 Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesActionsTest-512244481-project Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 417e43f1e4e548aab3988b32fa36dafa Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesActionsTest-512244481-project Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance f1379861-8927-4ad9-8037-b8661b257ccd could not be found. Aug 30 12:16:19.858810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': 'f1379861-8927-4ad9-8037-b8661b257ccd'} Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1379861-8927-4ad9-8037-b8661b257ccd could not be found. Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:16:19.859926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1379861-8927-4ad9-8037-b8661b257ccd could not be found. Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1379861-8927-4ad9-8037-b8661b257ccd could not be found. Aug 30 12:16:19.862286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:19.863441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Returning 404 to user: Instance f1379861-8927-4ad9-8037-b8661b257ccd could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:16:19.863441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ac50c7b4-21c0-4d72-a116-5af067d44278 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd" status: 404 len: 111 microversion: 2.1 time: 0.031349 Aug 30 12:16:19.863441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 459/934] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:19 2022] GET /compute/v2.1/servers/f1379861-8927-4ad9-8037-b8661b257ccd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:16:19.963915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1872064193", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "networks": [{"uuid": "ecfe3e8d-a172-45bc-a9fe-2e88fa36b606"}]}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:20.020379 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] validate_networks() for [('ecfe3e8d-a172-45bc-a9fe-2e88fa36b606', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:16:20.351277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:20.352260 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:20.354420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:20.359306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:20.359808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:20.360311 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:20.361014 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:20.361473 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:20.361900 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:20.503199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:20.511757 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b1513178-d223-41ec-b8fc-f0a221537d46 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.164899 Aug 30 12:16:20.512589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 460/935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:20 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:20.531577 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:16:20.532107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:16:20.532507 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:16:20.532920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:16:20.533369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:16:20.543530 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:20.544059 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:20.544497 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:20.545220 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:20.545674 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:20.546103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:20.563216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Getting quotas for project e379bccda6e44614b0b19f2552195939. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:16:20.567236 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Getting quotas for user 417e43f1e4e548aab3988b32fa36dafa and project e379bccda6e44614b0b19f2552195939. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:16:20.578789 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:16:20.581105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:16:20.699040 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-be519d6d-51ee-4345-a607-6578bce2bef9 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739258 Aug 30 12:16:20.699678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 476/936] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:16:20.710362 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8a511e04-cfad-4c85-a114-6164ee4de5d4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:20.710979 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8a511e04-cfad-4c85-a114-6164ee4de5d4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:20.766882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8a511e04-cfad-4c85-a114-6164ee4de5d4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:20.774666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8a511e04-cfad-4c85-a114-6164ee4de5d4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1214 microversion: 2.1 time: 0.068119 Aug 30 12:16:20.775231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 461/937] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:20 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:21.533714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:21.534329 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:21.541704 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:21.542187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:21.542619 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:21.543309 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:21.543760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:21.544206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:21.684570 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:21.692408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4bc634fa-fc60-43ff-946b-fec420bbbcae tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.162981 Aug 30 12:16:21.692982 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 477/938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:21 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:21.795080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:21.795721 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:21.802138 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:21.802653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:21.803090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:21.803779 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:21.804271 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:21.804701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:21.868810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:21.872386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:21.876889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a5c30dbb-99a2-404a-ad58-27d5d15902da tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1218 microversion: 2.1 time: 0.085696 Aug 30 12:16:21.877486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 462/939] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:21 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:22.715124 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:22.715740 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:22.723325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:22.723820 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:22.724286 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:22.724986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:22.725444 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:22.725869 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:22.857943 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:22.868064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e89f4729-72c2-42e2-9f37-2daeb9b83037 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.157071 Aug 30 12:16:22.869128 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 478/940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:22 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:22.898197 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:22.899022 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:22.906928 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:22.907281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:22.908041 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:22.908740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:22.909193 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:22.909612 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:22.980527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:22.988623 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fd9fded1-9582-4bb7-ab6c-b0e71f57f00b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1274 microversion: 2.1 time: 0.094619 Aug 30 12:16:22.989197 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 463/941] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:22 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:23.892056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:23.892677 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:23.899336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:23.899825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:23.900295 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:23.900997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:23.901454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:23.902067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:24.015039 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:24.015640 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:24.022607 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:24.023090 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:24.023558 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:24.024589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:24.025046 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:24.025471 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:24.145901 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:24.154093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a16c1132-0328-401b-a9f9-bfe81bbcfe6b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.265877 Aug 30 12:16:24.165276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 479/942] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:23 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:24.165560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:24.171183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c3c102ef-c2e1-40c0-9d1d-59aebf5769bb tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.160280 Aug 30 12:16:24.171760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 464/943] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:24 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:24.646042 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-c2074d5f-480c-4e6e-a236-0c6ccc033747 req-9a4dff8d-36af-463d-969d-39010ea837b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4a2abc-6f16-4ada-9c90-059d88bac50f", "name": "network-vif-plugged", "status": "completed", "tag": "f7343819-b8c6-453c-a9a4-b895882763d1"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:24.656842 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c2074d5f-480c-4e6e-a236-0c6ccc033747 req-9a4dff8d-36af-463d-969d-39010ea837b7 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:24.657316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c2074d5f-480c-4e6e-a236-0c6ccc033747 req-9a4dff8d-36af-463d-969d-39010ea837b7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:24.657774 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c2074d5f-480c-4e6e-a236-0c6ccc033747 req-9a4dff8d-36af-463d-969d-39010ea837b7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:24.670894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-72482ab9-0910-415c-81c1-96f6fe3a59b6 req-d65c7ecd-02fb-4632-a2f4-a7cc6d185b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536ebc96-3d56-452e-bfc0-02ec87ce434c", "tag": "1f0430df-97a2-44b3-a01f-cfd79d7732f8"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:24.671148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-c2074d5f-480c-4e6e-a236-0c6ccc033747 req-9a4dff8d-36af-463d-969d-39010ea837b7 service nova] Creating event network-vif-plugged:f7343819-b8c6-453c-a9a4-b895882763d1 for instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f on hv-cinder-83976 Aug 30 12:16:24.677236 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-c2074d5f-480c-4e6e-a236-0c6ccc033747 req-9a4dff8d-36af-463d-969d-39010ea837b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034875 Aug 30 12:16:24.678236 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 480/944] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:24.683700 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-72482ab9-0910-415c-81c1-96f6fe3a59b6 req-d65c7ecd-02fb-4632-a2f4-a7cc6d185b5a service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:24.684427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-72482ab9-0910-415c-81c1-96f6fe3a59b6 req-d65c7ecd-02fb-4632-a2f4-a7cc6d185b5a service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:24.685029 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-72482ab9-0910-415c-81c1-96f6fe3a59b6 req-d65c7ecd-02fb-4632-a2f4-a7cc6d185b5a service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:24.699220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-72482ab9-0910-415c-81c1-96f6fe3a59b6 req-d65c7ecd-02fb-4632-a2f4-a7cc6d185b5a service nova] Creating event network-changed:1f0430df-97a2-44b3-a01f-cfd79d7732f8 for instance 536ebc96-3d56-452e-bfc0-02ec87ce434c on hv-cinder-83976 Aug 30 12:16:24.704851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-72482ab9-0910-415c-81c1-96f6fe3a59b6 req-d65c7ecd-02fb-4632-a2f4-a7cc6d185b5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038300 Aug 30 12:16:24.706053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 465/945] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:25.178550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:25.180010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:25.186361 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:25.187006 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:25.188192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:25.188902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:25.189489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:25.195733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:25.196510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:25.199671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:25.203012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:25.203638 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:25.204205 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:25.205811 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:25.206367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:25.206974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:25.345562 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:25.356188 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:25.356757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-769746dc-fe53-4e8c-be66-76cc0ecc823c tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.182227 Aug 30 12:16:25.356757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 481/946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:25 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:25.363105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b648661d-e8e3-4104-b6e8-0d3aae5d2c2d tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.172181 Aug 30 12:16:25.364066 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 466/947] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:25 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:26.376977 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:26.377602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:26.380109 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:26.384210 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:26.384822 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:26.385562 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:26.386075 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:26.386529 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:26.387213 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:26.387674 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:26.388156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:26.391230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:26.395652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:26.395652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:26.395652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:26.395652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:26.396068 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:26.535033 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:26.543307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c8ebc253-055b-4410-a75a-c90c65813ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1265 microversion: 2.1 time: 0.170211 Aug 30 12:16:26.543894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 482/948] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:26 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:26.558710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:26.566387 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4a74073b-5c3b-46e0-8614-ec71723e5946 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.186548 Aug 30 12:16:26.572316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 467/949] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:26 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:27.565627 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:27.566256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:27.573537 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:27.574153 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:27.574608 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:27.575287 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:27.575741 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:27.576203 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:27.596549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:27.596549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:27.598731 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:27.599207 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:27.599633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:27.600400 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:27.600850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:27.601268 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:27.743291 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:27.751608 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d0fcdb5c-1ca4-45dc-bf84-c4d2e122eb97 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.163742 Aug 30 12:16:27.752239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 468/950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:27 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:27.970514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:27.979181 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cbb02328-d583-4e8f-9e02-942d3fe04a48 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1451 microversion: 2.1 time: 0.417702 Aug 30 12:16:27.979744 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 483/951] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:27 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1451 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:28.004234 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:28.004933 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:28.010754 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:28.011239 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:28.011671 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:28.012384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:28.012838 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:28.013258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:28.151499 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:28.159128 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3e97a6d3-dbe5-4ca1-aee3-f4b8725890a4 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1451 microversion: 2.1 time: 0.158759 Aug 30 12:16:28.159722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 469/952] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:27 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:28.773064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:28.774436 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:28.781237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:28.781747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:28.782173 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:28.782859 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:28.783311 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:28.783810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:28.787885 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=100 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:29.026739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:29.034679 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-759eee8e-8e66-48fe-9c20-b11674ab2ccf tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.265434 Aug 30 12:16:29.035247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 484/953] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:28 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:30.056663 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:30.057286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:30.064139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:30.064633 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:30.065099 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:30.065806 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:30.066262 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:30.066687 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:30.205318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:30.214150 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-6dd32848-75fc-4fc1-b52b-8b9e99c6319b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.162171 Aug 30 12:16:30.215019 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 470/954] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:30 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:30.240737 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-0bfeec23-0be0-4de2-a27c-deecb92f1860 req-0f1f0092-1ed9-4469-9a2c-79fb621f559d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4a2abc-6f16-4ada-9c90-059d88bac50f", "tag": "f7343819-b8c6-453c-a9a4-b895882763d1"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:30.251560 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-0bfeec23-0be0-4de2-a27c-deecb92f1860 req-0f1f0092-1ed9-4469-9a2c-79fb621f559d service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:30.252140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-0bfeec23-0be0-4de2-a27c-deecb92f1860 req-0f1f0092-1ed9-4469-9a2c-79fb621f559d service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:30.252577 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-0bfeec23-0be0-4de2-a27c-deecb92f1860 req-0f1f0092-1ed9-4469-9a2c-79fb621f559d service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:30.264950 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-0bfeec23-0be0-4de2-a27c-deecb92f1860 req-0f1f0092-1ed9-4469-9a2c-79fb621f559d service nova] Creating event network-changed:f7343819-b8c6-453c-a9a4-b895882763d1 for instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f on hv-cinder-83976 Aug 30 12:16:30.268762 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-0bfeec23-0be0-4de2-a27c-deecb92f1860 req-0f1f0092-1ed9-4469-9a2c-79fb621f559d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032866 Aug 30 12:16:30.269359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 485/955] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:31.180537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:31.181160 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:31.184537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:31.188886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.189532 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.189969 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.190669 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.191121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.191549 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.219653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-74a48078-de82-45c8-a494-e69428a37571 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067/ips" status: 200 len: 151 microversion: 2.1 time: 0.043987 Aug 30 12:16:31.220290 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 471/956] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:16:31 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:31.229938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:31.230897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:31.236261 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0bfe56e-5abe-4848-be5b-bd8af2c491ef"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:31.236718 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:31.237342 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:31.239344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:31.244872 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.245355 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.245791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.246500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.246845 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.247308 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.247405 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.247485 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.248087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.248785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.249245 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.249700 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.354354 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Invalid volume: volume f0bfe56e-5abe-4848-be5b-bd8af2c491ef is already attached to instances: 50cecfc5-00b5-4622-bdd8-146775076449 Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: POST /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067/os-volume_attachments HTTP/1.1 Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 74 Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:16:31.356505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {"volumeAttachment": {"volumeId": "f0bfe56e-5abe-4848-be5b-bd8af2c491ef"}} Aug 30 12:16:31.358314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Invalid volume: volume f0bfe56e-5abe-4848-be5b-bd8af2c491ef is already attached to instances: 50cecfc5-00b5-4622-bdd8-146775076449 Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'server_id': 'c4ac18f1-5916-427c-afdf-a5c3bd612067', 'body': {'volumeAttachment': {'volumeId': 'f0bfe56e-5abe-4848-be5b-bd8af2c491ef'}}} Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f0bfe56e-5abe-4848-be5b-bd8af2c491ef is already attached to instances: 50cecfc5-00b5-4622-bdd8-146775076449 Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:31.359702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f0bfe56e-5abe-4848-be5b-bd8af2c491ef is already attached to instances: 50cecfc5-00b5-4622-bdd8-146775076449 Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:31.361911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f0bfe56e-5abe-4848-be5b-bd8af2c491ef is already attached to instances: 50cecfc5-00b5-4622-bdd8-146775076449 Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 400 to user: Invalid volume: volume f0bfe56e-5abe-4848-be5b-bd8af2c491ef is already attached to instances: 50cecfc5-00b5-4622-bdd8-146775076449 {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7069820b-efa1-4258-9fbe-8ae974622ea4 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129129 Aug 30 12:16:31.363636 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 486/957] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:16:31 2022] POST /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 12:16:31.369242 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:31.382103 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:31.394634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.395136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.395617 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.396342 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.396798 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.397759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.443125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:31.453299 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:16:31.460126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f4149601-ca6c-4dbd-86fb-5c2efee5ea36 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.222417 Aug 30 12:16:31.460126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 472/958] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:31 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:31.748826 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-861ec352-3a40-4454-b7e7-0f3ff663d7bb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 204 len: 0 microversion: 2.1 time: 0.384657 Aug 30 12:16:31.749414 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 487/959] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:16:31 2022] DELETE /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:16:31.757377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:31.758009 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:31.763965 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.768810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.768810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.768810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:31.768810 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:31.769221 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:31.900557 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:31.908247 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-aecc19c0-52dc-409f-b8ff-3c466d087229 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1683 microversion: 2.1 time: 0.154610 Aug 30 12:16:31.908824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 473/960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:31 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:32.478188 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:32.478886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:32.485582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:32.486061 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:32.486496 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:32.487184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:32.487638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:32.488097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:32.635109 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:32.644187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7043fd51-eedc-4a42-a93d-7a8cd83d0e20 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.170896 Aug 30 12:16:32.644697 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 488/961] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:32 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:32.739084 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-c0711813-0865-4f2d-873f-b07ba7cc779e req-10957de2-64c7-45a9-82cc-c399059953f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536ebc96-3d56-452e-bfc0-02ec87ce434c", "name": "network-vif-plugged", "status": "completed", "tag": "1f0430df-97a2-44b3-a01f-cfd79d7732f8"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:32.749781 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-c0711813-0865-4f2d-873f-b07ba7cc779e req-10957de2-64c7-45a9-82cc-c399059953f9 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:32.750266 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-c0711813-0865-4f2d-873f-b07ba7cc779e req-10957de2-64c7-45a9-82cc-c399059953f9 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:32.750691 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-c0711813-0865-4f2d-873f-b07ba7cc779e req-10957de2-64c7-45a9-82cc-c399059953f9 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:32.762692 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-c0711813-0865-4f2d-873f-b07ba7cc779e req-10957de2-64c7-45a9-82cc-c399059953f9 service nova] Creating event network-vif-plugged:1f0430df-97a2-44b3-a01f-cfd79d7732f8 for instance 536ebc96-3d56-452e-bfc0-02ec87ce434c on hv-cinder-83976 Aug 30 12:16:32.768232 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-c0711813-0865-4f2d-873f-b07ba7cc779e req-10957de2-64c7-45a9-82cc-c399059953f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033886 Aug 30 12:16:32.768816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 474/962] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:32.929602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:32.930274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:32.936406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:32.936886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:32.937318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:32.938007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:32.938460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:32.938882 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:33.093148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:33.101277 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e3776ac1-7bc0-4388-8f68-454b987fa092 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1683 microversion: 2.1 time: 0.175575 Aug 30 12:16:33.106343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 489/963] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:32 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:33.668983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:33.670020 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:33.677806 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:33.678556 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:33.679151 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:33.680085 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:33.680624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:33.681235 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:33.931112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:33.938913 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1f0084aa-feb0-4aad-b9f9-e75b7b17c347 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1314 microversion: 2.1 time: 0.276890 Aug 30 12:16:33.939500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 475/964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:33 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:34.125938 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:34.129282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:34.134315 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:34.134810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:34.135246 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:34.136018 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:34.136706 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:34.137138 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:34.210960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:34.219196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fa99b37a-5334-4eee-8a1b-6e3368a2a135 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1615 microversion: 2.1 time: 0.097374 Aug 30 12:16:34.220012 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 490/965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:34 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:34.443590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-1706f5b6-2aff-4629-907e-d5bf1e9ee7a3 req-d7070158-d254-4cd2-b7ba-c8a537518b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ac18f1-5916-427c-afdf-a5c3bd612067", "name": "network-vif-deleted", "tag": "7451aacd-101c-4f0a-b6c0-344d5ed44132"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:34.453257 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-1706f5b6-2aff-4629-907e-d5bf1e9ee7a3 req-d7070158-d254-4cd2-b7ba-c8a537518b18 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:34.453742 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-1706f5b6-2aff-4629-907e-d5bf1e9ee7a3 req-d7070158-d254-4cd2-b7ba-c8a537518b18 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:34.454170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-1706f5b6-2aff-4629-907e-d5bf1e9ee7a3 req-d7070158-d254-4cd2-b7ba-c8a537518b18 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:34.465963 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-1706f5b6-2aff-4629-907e-d5bf1e9ee7a3 req-d7070158-d254-4cd2-b7ba-c8a537518b18 service nova] Creating event network-vif-deleted:7451aacd-101c-4f0a-b6c0-344d5ed44132 for instance c4ac18f1-5916-427c-afdf-a5c3bd612067 on hv-cinder-83976 Aug 30 12:16:34.470892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-1706f5b6-2aff-4629-907e-d5bf1e9ee7a3 req-d7070158-d254-4cd2-b7ba-c8a537518b18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031068 Aug 30 12:16:34.471675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 476/966] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:16:34.960304 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:34.960913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:34.967486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:34.968087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:34.968535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:34.969252 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:34.969714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:34.970139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:35.112383 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:35.126799 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0cb8b54a-ac8e-4932-9d8e-1476a61908b4 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1499 microversion: 2.1 time: 0.170493 Aug 30 12:16:35.127464 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 491/967] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:34 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1499 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:35.241830 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:35.243289 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:35.251417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:35.257816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:35.257816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:35.257816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:35.257816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:35.258693 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:35.287812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:35.288344 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:35.288787 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:35.289324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lazy-loading 'fault' on Instance uuid c4ac18f1-5916-427c-afdf-a5c3bd612067 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:16:35.335375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:35.344256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5fab735b-4c19-40cc-8886-466de65c9195 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 200 len: 1331 microversion: 2.1 time: 0.107069 Aug 30 12:16:35.344825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 477/968] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:35 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:36.077187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:36.077692 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:36.084363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:36.084850 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:36.085282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:36.085983 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:36.086539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:36.086969 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:36.113306 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:16:36.375016 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:36.375707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:36.382467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:36.382976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:36.384192 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:36.385082 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:36.385545 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:36.385975 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:36.400599 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 HTTP/1.1 Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:16:36.402248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:16:36.403710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': 'c4ac18f1-5916-427c-afdf-a5c3bd612067'} Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:16:36.404873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:16:36.406489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:36.408290 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:16:36.408290 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c70d2819-daf7-40fa-be38-e13a22856d8a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 404 len: 111 microversion: 2.1 time: 0.032595 Aug 30 12:16:36.408290 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 478/969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:36 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 12:16:36.412264 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d40742cd-1fae-455b-a8db-7b9492df7ed1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '.version_select at 0x7efe4ed8f430>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:36.424331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0d1253a5-023e-40c4-9b1f-826cac6a754b tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "DELETE /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 204 len: 0 microversion: 2.1 time: 0.340551 Aug 30 12:16:36.424331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 492/970] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:16:36 2022] DELETE /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:16:36.432975 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:36.433929 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:36.439838 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:36.440362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:36.440830 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:36.441541 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:36.441985 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:36.442414 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:36.534842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d40742cd-1fae-455b-a8db-7b9492df7ed1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-416833577" status: 202 len: 0 microversion: 2.1 time: 0.126032 Aug 30 12:16:36.535485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 479/971] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Aug 30 12:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-416833577 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:16:36.583612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:36.593875 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-da5019fc-dbcc-4596-8399-464552c4db0f tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1505 microversion: 2.1 time: 0.166125 Aug 30 12:16:36.594456 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 493/972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:36 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:37.375112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:37.375666 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:37.384410 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:37.384904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:37.385344 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:37.386133 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:37.386594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:37.387019 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:37.468512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lazy-loading 'services' on Instance uuid 50cecfc5-00b5-4622-bdd8-146775076449 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:16:37.615791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:37.616461 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:37.624029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:37.624518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:37.624952 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:37.625639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:37.626091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:37.626513 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:37.641762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-09432d5a-ad76-45d7-9d94-dd9009960306 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments/f0bfe56e-5abe-4848-be5b-bd8af2c491ef" status: 202 len: 0 microversion: 2.1 time: 0.270421 Aug 30 12:16:37.642349 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 480/973] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:16:37 2022] DELETE /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments/f0bfe56e-5abe-4848-be5b-bd8af2c491ef => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:16:37.651837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:37.654414 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:37.661305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:37.661791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:37.662269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:37.662953 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:37.663512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:37.663845 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:37.700340 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c2c9d6ab-9640-44bc-925a-a5065453fc51 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052724 Aug 30 12:16:37.700906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 481/974] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:16:37 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:37.794244 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:37.802192 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-df4592b5-b148-49b1-9a68-fb042f375715 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1505 microversion: 2.1 time: 0.190273 Aug 30 12:16:37.802767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 494/975] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:37 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:38.715002 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:38.717284 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:38.724114 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:38.724609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:38.725049 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:38.725753 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:38.726212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:38.726642 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:38.746132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:38.761030 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8f86b339-cd71-4e97-8bde-5c11c03acb05 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050888 Aug 30 12:16:38.762029 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 482/976] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:16:38 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:38.823110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:38.824549 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:38.831378 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:38.832041 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:38.832745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:38.833612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:38.834276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:38.835503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:39.067900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:39.084134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ffdc100a-0491-418e-a0d3-99798f72beae tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1505 microversion: 2.1 time: 0.262826 Aug 30 12:16:39.084134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 495/977] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:38 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:39.223180 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-156136de-22ab-46f4-9f0e-9c32b789c6d3 req-9fba941e-3082-4b01-aa46-2b50998294e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536ebc96-3d56-452e-bfc0-02ec87ce434c", "name": "network-vif-deleted", "tag": "1f0430df-97a2-44b3-a01f-cfd79d7732f8"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:39.234855 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-156136de-22ab-46f4-9f0e-9c32b789c6d3 req-9fba941e-3082-4b01-aa46-2b50998294e7 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:39.235325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-156136de-22ab-46f4-9f0e-9c32b789c6d3 req-9fba941e-3082-4b01-aa46-2b50998294e7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:39.235745 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-156136de-22ab-46f4-9f0e-9c32b789c6d3 req-9fba941e-3082-4b01-aa46-2b50998294e7 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:39.247279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-156136de-22ab-46f4-9f0e-9c32b789c6d3 req-9fba941e-3082-4b01-aa46-2b50998294e7 service nova] Creating event network-vif-deleted:1f0430df-97a2-44b3-a01f-cfd79d7732f8 for instance 536ebc96-3d56-452e-bfc0-02ec87ce434c on hv-cinder-83976 Aug 30 12:16:39.259352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-156136de-22ab-46f4-9f0e-9c32b789c6d3 req-9fba941e-3082-4b01-aa46-2b50998294e7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038258 Aug 30 12:16:39.259352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 483/978] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:39.773532 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:39.775791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:39.781850 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:39.782323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:39.782749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:39.783423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:39.783871 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:39.784312 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:39.813760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-faf79a6a-c23e-4459-9c52-dfff83264e49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044131 Aug 30 12:16:39.814305 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 496/979] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:16:39 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:16:39.880791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:39.881566 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:39.890813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:39.891379 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:39.891868 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:39.892980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:39.893433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:39.893891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:39.921997 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:16:40.106486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:40.107109 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:40.113734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:40.114222 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:40.114664 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:40.115363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:40.115823 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:40.116277 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:40.148169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:40.149219 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:40.149932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:40.150430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lazy-loading 'fault' on Instance uuid 536ebc96-3d56-452e-bfc0-02ec87ce434c {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:16:40.192641 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417e43f1e4e548aab3988b32fa36dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e379bccda6e44614b0b19f2552195939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:40.194923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:40.201582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8a2fd7be-aa5c-4e40-99fd-3c47cec25328 tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 200 len: 1304 microversion: 2.1 time: 0.101475 Aug 30 12:16:40.202507 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 497/980] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:40 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:40.292359 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c1fb5816-4c2b-4b6c-9702-0ad1b254dca2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 204 len: 0 microversion: 2.1 time: 0.417778 Aug 30 12:16:40.292952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 484/981] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:16:39 2022] DELETE /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:16:40.303740 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:40.304408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:40.311634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:40.312670 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:40.313113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:40.313811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:40.314256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:40.314925 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:40.452575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:40.460364 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a2c2b2f0-55ef-445e-bc09-ea544d1a7ed7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1682 microversion: 2.1 time: 0.163219 Aug 30 12:16:40.460985 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 498/982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:40 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:41.222944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:41.223698 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] [instance: 536ebc96-3d56-452e-bfc0-02ec87ce434c] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:41.231147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:41.231637 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:41.232119 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:41.232817 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:41.233367 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:41.233800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:41.249662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] HTTP exception thrown: Instance 536ebc96-3d56-452e-bfc0-02ec87ce434c could not be found. Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Request method failure captured: Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c HTTP/1.1 Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf93xDLHSqmI6oFl_VftIRT0Cxep_PV6VqJ8OqtsiI-SuL6ySoA65wJ0d05x8jwxWbtIN0nJEhUqfRRhVVPl_cKJ-9MEe6d-q-dCMsoZ6Q7xkPGyhFWNmDEaoWsVDSbP9nXRk0Hb29pAZCcIGSDVxXJ_jNGo3BchdMgxH1hmMoRXYDM Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: e379bccda6e44614b0b19f2552195939 Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-VolumesActionsTest-512244481 Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:16:41.251325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e379bccda6e44614b0b19f2552195939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e379bccda6e44614b0b19f2552195939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e379bccda6e44614b0b19f2552195939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e379bccda6e44614b0b19f2552195939"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-VolumesActionsTest-512244481 Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: e379bccda6e44614b0b19f2552195939 Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-VolumesActionsTest-512244481 Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-VolumesActionsTest-512244481-project Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 417e43f1e4e548aab3988b32fa36dafa Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-VolumesActionsTest-512244481-project Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 536ebc96-3d56-452e-bfc0-02ec87ce434c could not be found. Aug 30 12:16:41.257331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '536ebc96-3d56-452e-bfc0-02ec87ce434c'} Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536ebc96-3d56-452e-bfc0-02ec87ce434c could not be found. Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:16:41.258952 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536ebc96-3d56-452e-bfc0-02ec87ce434c could not be found. Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536ebc96-3d56-452e-bfc0-02ec87ce434c could not be found. Aug 30 12:16:41.260335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:16:41.261590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] Returning 404 to user: Instance 536ebc96-3d56-452e-bfc0-02ec87ce434c could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:16:41.261590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b602731e-fdb2-4d4a-8d40-d85414e801fa tempest-VolumesActionsTest-512244481 tempest-VolumesActionsTest-512244481-project] 10.222.0.42 "GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c" status: 404 len: 111 microversion: 2.1 time: 0.035035 Aug 30 12:16:41.261590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 485/983] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:41 2022] GET /compute/v2.1/servers/536ebc96-3d56-452e-bfc0-02ec87ce434c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:16:41.483053 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:41.483814 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:41.490268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:41.490749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:41.491205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:41.491886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:41.492413 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:41.492862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:41.637164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:41.645274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f8e49825-7c3f-4e82-8fa4-81473f6ff6a9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1682 microversion: 2.1 time: 0.166713 Aug 30 12:16:41.649247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 499/984] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:41 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:42.669335 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:42.670146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:42.681077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:42.681585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:42.682370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:42.682945 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:42.683468 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:42.683980 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:42.799314 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:42.808515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3ee22338-0061-4ad0-8477-94d3cf9b0067 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1615 microversion: 2.1 time: 0.143018 Aug 30 12:16:42.809486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 486/985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:42 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1615 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:43.051483 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-72e7f6a1-e912-4e2d-8833-2c6ea278a2b0 req-422f7e6d-1c09-4480-9ca4-d08b08717b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cecfc5-00b5-4622-bdd8-146775076449", "name": "network-vif-deleted", "tag": "8857a41e-2e83-4898-8bad-9c9fd9ab711d"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:43.062331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-72e7f6a1-e912-4e2d-8833-2c6ea278a2b0 req-422f7e6d-1c09-4480-9ca4-d08b08717b76 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:43.062828 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-72e7f6a1-e912-4e2d-8833-2c6ea278a2b0 req-422f7e6d-1c09-4480-9ca4-d08b08717b76 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:43.063476 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-72e7f6a1-e912-4e2d-8833-2c6ea278a2b0 req-422f7e6d-1c09-4480-9ca4-d08b08717b76 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:43.076137 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-72e7f6a1-e912-4e2d-8833-2c6ea278a2b0 req-422f7e6d-1c09-4480-9ca4-d08b08717b76 service nova] Creating event network-vif-deleted:8857a41e-2e83-4898-8bad-9c9fd9ab711d for instance 50cecfc5-00b5-4622-bdd8-146775076449 on hv-cinder-83976 Aug 30 12:16:43.081465 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-72e7f6a1-e912-4e2d-8833-2c6ea278a2b0 req-422f7e6d-1c09-4480-9ca4-d08b08717b76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 Aug 30 12:16:43.084684 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 500/986] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:43.830031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:43.830640 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:43.839560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:43.840091 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:43.840527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:43.841230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:43.843623 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:43.844178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:43.915547 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:43.923743 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-60008e18-42df-41e7-8f88-58de62d3d599 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1615 microversion: 2.1 time: 0.097804 Aug 30 12:16:43.924324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 487/987] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:43 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:16:44.946144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:44.946762 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:44.952964 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:44.953450 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:44.953888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:44.954578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:44.955037 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:44.955469 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:45.017833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:45.025981 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d6a6afdd-564f-42b7-b3be-089a37e846fe tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1615 microversion: 2.1 time: 0.084719 Aug 30 12:16:45.026883 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 501/988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:44 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:46.046622 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:46.047219 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:46.053656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:46.054130 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:46.054555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:46.055726 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:46.056210 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:46.056627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:46.087790 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:46.088302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:46.088734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:46.089173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lazy-loading 'fault' on Instance uuid 50cecfc5-00b5-4622-bdd8-146775076449 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:16:46.129579 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:46.138430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3ffd8ab1-e5e4-41ec-bd54-d23ab119446c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 200 len: 1331 microversion: 2.1 time: 0.095558 Aug 30 12:16:46.138996 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 488/989] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:46 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:47.159647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:47.161166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:47.169620 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:47.185284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:47.185284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:47.185284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:47.185284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:47.185724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:47.187073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 HTTP/1.1 Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:16:47.189054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:16:47.190437 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '50cecfc5-00b5-4622-bdd8-146775076449'} Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:16:47.191231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:16:47.192580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:16:47.195135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:16:47.196368 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a771fbf4-1547-4526-99f1-beae4ddb27d1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 404 len: 111 microversion: 2.1 time: 0.040602 Aug 30 12:16:47.201290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 502/990] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:47 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:16:47.206233 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bb801df0-22d1-499e-a722-a3b328210a72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '.version_select at 0x7efe4edd5dc0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:47.299033 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bb801df0-22d1-499e-a722-a3b328210a72 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324069707" status: 202 len: 0 microversion: 2.1 time: 0.096609 Aug 30 12:16:47.300676 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 489/991] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Aug 30 12:16:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324069707 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:16:48.293125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-153f5191-2a12-4a51-b96b-efcd5d38cc77 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: .version_select at 0x7efe4ec36ee0>, body: {"keypair": {"name": "tempest-keypair-68482513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD0x0oE/aKygp8CakcwvjGrwULa2v+w5SRUJwaQ/QbgVcUy+9/XXqJeg14WIv0PhMBmcPFa0E+hru4B8t85zYfLCOEKgPvIZzLsK2/sQtJoyPP0kG1uzsoDhxByhMbpgw=="}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:48.313144 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-153f5191-2a12-4a51-b96b-efcd5d38cc77 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:16:48.317874 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-153f5191-2a12-4a51-b96b-efcd5d38cc77 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:16:48.397986 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-153f5191-2a12-4a51-b96b-efcd5d38cc77 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.108725 Aug 30 12:16:48.399352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 503/992] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:16:48 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:51.179398 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-751478185", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5440e9-8593-4ddc-a45f-ad471b8efbac"}], "security_groups": [{"name": "tempest-securitygroup--632543925"}], "key_name": "tempest-keypair-68482513", "user_data": "}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:51.216609 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:51.342758 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] validate_networks() for [('4d5440e9-8593-4ddc-a45f-ad471b8efbac', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:16:51.774529 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:16:51.775081 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:16:51.776307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:16:51.776734 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:16:51.780440 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:16:51.791445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:51.792010 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:51.792452 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:51.793199 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:51.793638 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:51.794058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:51.811514 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:16:51.815792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:16:51.830525 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:16:51.832866 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:16:52.028040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cb207a29-910d-46a9-ae33-0fc26f66cd12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.858041 Aug 30 12:16:52.029094 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 490/993] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:16:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:16:52.041907 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c94bd308-9077-4750-9f07-ca68cca9d22c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:52.043575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c94bd308-9077-4750-9f07-ca68cca9d22c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:52.129142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c94bd308-9077-4750-9f07-ca68cca9d22c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:52.140924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c94bd308-9077-4750-9f07-ca68cca9d22c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1239 microversion: 2.1 time: 0.104587 Aug 30 12:16:52.141858 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 504/994] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:52 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1239 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:53.171406 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:53.174936 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:53.190495 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:53.191688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:53.192901 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:53.194886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:53.195512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:53.196137 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:53.262404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:53.272141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d78f64ce-b471-4e1e-989f-e0d99de14626 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1243 microversion: 2.1 time: 0.112310 Aug 30 12:16:53.274223 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 491/995] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:53 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1243 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:54.295730 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:54.296415 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:54.308357 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:54.310187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:54.310187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:54.310454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:54.310833 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:54.311268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:54.401827 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:54.426472 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0c5c4d45-8b97-4b5a-9ff6-b415b918946a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1291 microversion: 2.1 time: 0.130026 Aug 30 12:16:54.427481 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 505/996] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:54 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1291 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:55.453125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:55.453880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:55.462938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:55.464660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:55.465286 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:55.466178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:55.466647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:55.467077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:55.627280 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:55.635867 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d936e2a6-bd48-426f-a8e1-284fed57d1ab tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1297 microversion: 2.1 time: 0.186550 Aug 30 12:16:55.636959 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 492/997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:55 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1297 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:56.657691 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:56.658919 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:56.670149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:56.678579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:56.678579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:56.678579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:56.678579 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:56.679069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:56.864872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:56.881416 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-33c8489f-bb3b-416e-ac8a-6844419f2c83 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1364 microversion: 2.1 time: 0.227352 Aug 30 12:16:56.898956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 506/998] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:56 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:57.361503 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-6b310561-0aec-41f1-8ad3-ddc8a65bf87c req-25dcc322-06ee-434e-a646-b5d9ff326e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d88dbf-62e5-46fb-acd9-8bce8ce4cb53", "tag": "dac372cb-1826-423b-9087-90f68b975142"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:16:57.424246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6b310561-0aec-41f1-8ad3-ddc8a65bf87c req-25dcc322-06ee-434e-a646-b5d9ff326e82 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:57.424246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6b310561-0aec-41f1-8ad3-ddc8a65bf87c req-25dcc322-06ee-434e-a646-b5d9ff326e82 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:57.424246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6b310561-0aec-41f1-8ad3-ddc8a65bf87c req-25dcc322-06ee-434e-a646-b5d9ff326e82 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:57.438320 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-6b310561-0aec-41f1-8ad3-ddc8a65bf87c req-25dcc322-06ee-434e-a646-b5d9ff326e82 service nova] Creating event network-changed:dac372cb-1826-423b-9087-90f68b975142 for instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 on hv-cinder-83976 Aug 30 12:16:57.444295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-6b310561-0aec-41f1-8ad3-ddc8a65bf87c req-25dcc322-06ee-434e-a646-b5d9ff326e82 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089688 Aug 30 12:16:57.451387 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 493/999] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:16:57.906408 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:57.907156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:57.909630 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:16:57.914914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:57.915400 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:57.919095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:57.919095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:57.919095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:57.919095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:58.088317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:58.097119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-c3954999-68f0-4f14-939d-262071a18478 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1364 microversion: 2.1 time: 0.194675 Aug 30 12:16:58.098264 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 507/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:57 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:16:59.122044 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:16:59.124147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:16:59.141295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:59.143486 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:59.152510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:59.153876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:16:59.154857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:16:59.155740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:16:59.425092 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:16:59.436951 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-aaf0b86f-6778-4292-b902-34e1e02f05ef tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1364 microversion: 2.1 time: 0.321713 Aug 30 12:16:59.453828 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 494/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:16:59 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:00.466124 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:00.466861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:00.473689 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:00.474558 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:00.475230 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:00.476202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:00.476792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:00.477454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:00.637609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:00.646427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cc1b756a-c812-494b-b852-f6ae4088984a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1364 microversion: 2.1 time: 0.184899 Aug 30 12:17:00.647418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 508/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:00 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:17:01.671208 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:01.672752 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:01.683124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:01.684430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:01.685052 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:01.685884 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:01.686546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:01.690159 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:01.746195 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-24de2438-bbcf-4e6d-af7a-2fb35b9dc65d req-d0ddb66f-a0d4-4de7-92ad-1fd1e7e0c277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d88dbf-62e5-46fb-acd9-8bce8ce4cb53", "name": "network-vif-plugged", "status": "completed", "tag": "dac372cb-1826-423b-9087-90f68b975142"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:01.762979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-24de2438-bbcf-4e6d-af7a-2fb35b9dc65d req-d0ddb66f-a0d4-4de7-92ad-1fd1e7e0c277 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:01.778500 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-24de2438-bbcf-4e6d-af7a-2fb35b9dc65d req-d0ddb66f-a0d4-4de7-92ad-1fd1e7e0c277 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:01.778500 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-24de2438-bbcf-4e6d-af7a-2fb35b9dc65d req-d0ddb66f-a0d4-4de7-92ad-1fd1e7e0c277 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:01.784929 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-24de2438-bbcf-4e6d-af7a-2fb35b9dc65d req-d0ddb66f-a0d4-4de7-92ad-1fd1e7e0c277 service nova] Creating event network-vif-plugged:dac372cb-1826-423b-9087-90f68b975142 for instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 on hv-cinder-83976 Aug 30 12:17:01.794272 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-24de2438-bbcf-4e6d-af7a-2fb35b9dc65d req-d0ddb66f-a0d4-4de7-92ad-1fd1e7e0c277 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065528 Aug 30 12:17:01.801846 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 509/1003] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:17:01.802446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:01.826616 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=6 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:01.991010 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:02.016243 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-dab04639-9eb5-4338-bb66-fe6636595e2f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1364 microversion: 2.1 time: 0.349818 Aug 30 12:17:02.027971 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 495/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:01 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1364 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:03.036242 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:03.041078 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:03.041775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:03.048157 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:03.048646 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:03.049077 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:03.049770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:03.050222 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:03.050639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:03.202098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:03.210135 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3336e93d-4e4c-414a-aa28-b77fd8bb857a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1364 microversion: 2.1 time: 0.174908 Aug 30 12:17:03.210785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 510/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:03 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:04.233741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:04.234439 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:04.241775 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:04.242256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:04.242780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:04.243476 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:04.243931 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:04.244373 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:04.541359 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:04.550274 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-7fece930-528a-4df6-8fc2-39561bddd75f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1554 microversion: 2.1 time: 0.320374 Aug 30 12:17:04.551017 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 496/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:04 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1554 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:04.572585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:04.573652 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:04.581039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:04.581601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:04.582101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:04.582877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:04.583406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:04.583917 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:04.681782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-08e65dc2-1868-4809-baff-fd23689e0bec tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111665 Aug 30 12:17:04.683187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 511/1007] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:17:04 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:05.840431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-72a483a5-fa6f-4924-8004-b1d1e63b6c48 req-56c2afda-016d-41ae-98b5-413ee0966a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d88dbf-62e5-46fb-acd9-8bce8ce4cb53", "tag": "dac372cb-1826-423b-9087-90f68b975142"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:05.850238 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-72a483a5-fa6f-4924-8004-b1d1e63b6c48 req-56c2afda-016d-41ae-98b5-413ee0966a91 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:05.855776 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-72a483a5-fa6f-4924-8004-b1d1e63b6c48 req-56c2afda-016d-41ae-98b5-413ee0966a91 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:05.855776 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-72a483a5-fa6f-4924-8004-b1d1e63b6c48 req-56c2afda-016d-41ae-98b5-413ee0966a91 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:05.865985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-72a483a5-fa6f-4924-8004-b1d1e63b6c48 req-56c2afda-016d-41ae-98b5-413ee0966a91 service nova] Creating event network-changed:dac372cb-1826-423b-9087-90f68b975142 for instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 on hv-cinder-83976 Aug 30 12:17:05.873591 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-72a483a5-fa6f-4924-8004-b1d1e63b6c48 req-56c2afda-016d-41ae-98b5-413ee0966a91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037324 Aug 30 12:17:05.874191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 497/1008] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:17:13.107102 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1800863148", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:13.161228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] validate_networks() for None {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:17:13.431404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:17:13.431825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:17:13.432319 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:17:13.432757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:17:13.433164 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:17:13.442038 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:13.442517 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:13.442946 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:13.443661 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:13.444140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:13.444565 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:13.451604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=60 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:13.461785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Getting quotas for project 517126879e6441358a6d6d9f9470be55. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:17:13.466276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Getting quotas for user ce2b555c8004406d95046b096bcbed1d and project 517126879e6441358a6d6d9f9470be55. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:17:13.476942 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:17:13.479186 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:17:13.642871 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-05e1558b-769f-46c6-9930-c1430a8aa888 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540457 Aug 30 12:17:13.643520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 512/1009] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:17:13.656277 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-da58a13c-d0c4-4971-b283-423d9ffd1807 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:13.656900 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-da58a13c-d0c4-4971-b283-423d9ffd1807 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:13.716475 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-da58a13c-d0c4-4971-b283-423d9ffd1807 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:13.723331 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-da58a13c-d0c4-4971-b283-423d9ffd1807 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1215 microversion: 2.1 time: 0.072678 Aug 30 12:17:13.723891 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 498/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:13 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:14.744909 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:14.745524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:14.754764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:14.755249 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:14.755684 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:14.756414 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:14.756871 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:14.757299 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:14.821105 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:14.829478 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b9e8ba48-44cb-4381-a10c-5dda7ec93fbc tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1219 microversion: 2.1 time: 0.089154 Aug 30 12:17:14.830043 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 513/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:14 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:15.850689 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:15.851299 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:15.858406 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:15.860640 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:15.861159 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:15.861594 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:15.862285 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:15.862737 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:15.863162 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:15.944652 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:15.952662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-af053308-36c1-4f79-871a-e7d33dcb26bd tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1267 microversion: 2.1 time: 0.105806 Aug 30 12:17:15.955390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 499/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:15 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:16.974507 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:16.977039 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:16.982007 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:16.982486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:16.982914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:16.983607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:16.984083 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:16.984503 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:17.128685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:17.136621 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-570e5584-ca0e-4a81-a792-01140b3ece70 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.166126 Aug 30 12:17:17.142189 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 514/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:16 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:17.808013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-8229767b-cadf-491f-823c-263cc63bd5f3 req-da09d145-727b-4b58-b885-9fa966d8f8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8a5917-c478-4119-a6f2-0ce03fd48028", "tag": "9d1f6444-5ef2-45b4-837e-3632675982f8"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:17.818961 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-8229767b-cadf-491f-823c-263cc63bd5f3 req-da09d145-727b-4b58-b885-9fa966d8f8ad service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:17.819443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-8229767b-cadf-491f-823c-263cc63bd5f3 req-da09d145-727b-4b58-b885-9fa966d8f8ad service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:17.819872 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-8229767b-cadf-491f-823c-263cc63bd5f3 req-da09d145-727b-4b58-b885-9fa966d8f8ad service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:17.831680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-8229767b-cadf-491f-823c-263cc63bd5f3 req-da09d145-727b-4b58-b885-9fa966d8f8ad service nova] Creating event network-changed:9d1f6444-5ef2-45b4-837e-3632675982f8 for instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 on hv-cinder-83976 Aug 30 12:17:17.836676 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-8229767b-cadf-491f-823c-263cc63bd5f3 req-da09d145-727b-4b58-b885-9fa966d8f8ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032851 Aug 30 12:17:17.837265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 500/1014] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:18.168695 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:18.169486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:18.176113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:18.176661 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:18.177133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:18.177836 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:18.178294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:18.178722 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:18.311056 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:18.320861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3c61edc3-102a-43f2-b691-c19e9f0f0208 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.166088 Aug 30 12:17:18.321519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 515/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:18 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:19.343722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:19.344362 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:19.350438 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:19.350915 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:19.351494 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:19.352204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:19.352656 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:19.353075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:19.481555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:19.489297 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-343af684-7bcb-4efc-a6b2-b794aaa6c20f tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.150988 Aug 30 12:17:19.489854 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 501/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:19 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:20.509967 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:20.510589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:20.517021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:20.517557 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:20.517995 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:20.518683 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:20.519139 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:20.519567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:20.648209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:20.656663 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0c619af6-220b-4a5c-aa09-281dbfdfbaea tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.150616 Aug 30 12:17:20.657228 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 516/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:20 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:21.676989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:21.677680 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:21.680047 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:21.684798 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:21.685289 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:21.685725 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:21.686420 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:21.686886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:21.687369 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:21.822880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:21.831398 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-acdc8b94-d977-4368-9172-df7061e4f2bf tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.158305 Aug 30 12:17:21.832212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 502/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:21 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:22.852893 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:22.853510 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:22.860169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:22.860952 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:22.861390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:22.862081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:22.862536 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:22.862958 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:22.987426 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:22.995036 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0b05583f-bc35-49db-8a37-5eacb3295777 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.146079 Aug 30 12:17:22.995603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 517/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:22 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:23.853628 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-dacfb3fb-9c83-4839-a18b-14acd976969e req-660d2f2f-1a8d-4f29-b4a5-844176c7ce9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8a5917-c478-4119-a6f2-0ce03fd48028", "name": "network-vif-plugged", "status": "completed", "tag": "9d1f6444-5ef2-45b4-837e-3632675982f8"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:23.858608 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:23.863916 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-dacfb3fb-9c83-4839-a18b-14acd976969e req-660d2f2f-1a8d-4f29-b4a5-844176c7ce9e service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:23.864452 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-dacfb3fb-9c83-4839-a18b-14acd976969e req-660d2f2f-1a8d-4f29-b4a5-844176c7ce9e service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:23.866300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-dacfb3fb-9c83-4839-a18b-14acd976969e req-660d2f2f-1a8d-4f29-b4a5-844176c7ce9e service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:23.875442 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-dacfb3fb-9c83-4839-a18b-14acd976969e req-660d2f2f-1a8d-4f29-b4a5-844176c7ce9e service nova] Creating event network-vif-plugged:9d1f6444-5ef2-45b4-837e-3632675982f8 for instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 on hv-cinder-83976 Aug 30 12:17:23.880146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-dacfb3fb-9c83-4839-a18b-14acd976969e req-660d2f2f-1a8d-4f29-b4a5-844176c7ce9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 Aug 30 12:17:23.880684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 503/1020] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:24.017533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:24.018142 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:24.020088 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:24.025796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:24.025935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:24.026328 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:24.026757 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:24.027442 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:24.027889 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:24.029057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:24.162096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:24.170393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8f4624bf-befb-437f-96e2-55f0415291a9 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.157716 Aug 30 12:17:24.170967 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 518/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:24 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:25.191761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:25.192489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:25.199161 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:25.199818 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:25.200379 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:25.201075 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:25.201533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:25.201955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:25.331281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:25.339416 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d2a89c8b-6dea-44fc-88c5-fee4d622ccba tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1315 microversion: 2.1 time: 0.152323 Aug 30 12:17:25.340377 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 504/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:25 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:26.361568 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:26.362134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:26.368815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:26.369293 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:26.369722 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:26.370406 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:26.370853 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:26.371270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:26.501404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:26.508800 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-69c331ae-9606-4442-98a7-dc412427b061 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1464 microversion: 2.1 time: 0.151419 Aug 30 12:17:26.509360 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 519/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:26 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:26.557795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:26.558769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:26.565318 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:26.565800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:26.566234 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:26.566922 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:26.567399 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:26.567824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:26.593962 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:17:26.842740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-b85fdb01-09f8-4043-9198-074b9507539e tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 204 len: 0 microversion: 2.1 time: 0.288522 Aug 30 12:17:26.843326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 505/1024] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:17:26 2022] DELETE /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:17:26.851581 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:26.852250 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:26.858276 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:26.858747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:26.859172 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:26.859847 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:26.860326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:26.861015 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:26.991278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:26.999302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8c5c80db-2a09-4a40-88bf-b7acfa078228 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1470 microversion: 2.1 time: 0.151656 Aug 30 12:17:26.999872 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 520/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:26 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:28.021847 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:28.022538 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:28.029115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:28.029588 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:28.030019 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:28.030694 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:28.031139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:28.031553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:28.159125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:28.166773 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f3d34d95-00b5-44d0-b6f5-92c2bd4bff30 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1470 microversion: 2.1 time: 0.149184 Aug 30 12:17:28.167336 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 506/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:28 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:29.052597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-2e165031-aab8-45d2-bb80-79d1f3df04b7 req-b20ba30a-3f75-497e-bf99-d4a41e1d4362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8a5917-c478-4119-a6f2-0ce03fd48028", "name": "network-vif-deleted", "tag": "9d1f6444-5ef2-45b4-837e-3632675982f8"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:29.058564 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:29.064764 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2e165031-aab8-45d2-bb80-79d1f3df04b7 req-b20ba30a-3f75-497e-bf99-d4a41e1d4362 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:29.065308 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2e165031-aab8-45d2-bb80-79d1f3df04b7 req-b20ba30a-3f75-497e-bf99-d4a41e1d4362 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:29.065802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2e165031-aab8-45d2-bb80-79d1f3df04b7 req-b20ba30a-3f75-497e-bf99-d4a41e1d4362 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:29.078325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-2e165031-aab8-45d2-bb80-79d1f3df04b7 req-b20ba30a-3f75-497e-bf99-d4a41e1d4362 service nova] Creating event network-vif-deleted:9d1f6444-5ef2-45b4-837e-3632675982f8 for instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 on hv-cinder-83976 Aug 30 12:17:29.083763 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-2e165031-aab8-45d2-bb80-79d1f3df04b7 req-b20ba30a-3f75-497e-bf99-d4a41e1d4362 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034833 Aug 30 12:17:29.084562 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 521/1027] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:29.187570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:29.188273 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:29.194839 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:29.195327 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:29.195762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:29.196497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:29.196956 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:29.197441 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:29.259613 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2b555c8004406d95046b096bcbed1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517126879e6441358a6d6d9f9470be55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:29.268220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-12371092-fa73-4365-a3f8-e46ff6cea666 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 200 len: 1300 microversion: 2.1 time: 0.084516 Aug 30 12:17:29.268800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 507/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:29 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:30.292901 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:30.293607 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] [instance: 3f8a5917-c478-4119-a6f2-0ce03fd48028] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:30.300322 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:30.306273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:30.306273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:30.306273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:30.306273 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:30.306671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:30.316641 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] HTTP exception thrown: Instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 could not be found. Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Request method failure captured: Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 HTTP/1.1 Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf_HM5A5lF26gSeW4va5bxuLu3tWT63-8zpZbIrrsMYdgTtfmHfYf9_DW7ZjTUFloqVxfR05rz4lkW-2ouv3DpGYKpUIbjyv-skDhJuwL_clUycFH9N0suUv-Hic5Q79Z8jgdrzCBpwHBZmJv5g-UiOirbaVx6rD3TrU4PVYvKDo_0o Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 517126879e6441358a6d6d9f9470be55 Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-VolumesNegativeTest-1848345604 Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:17:30.318316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/517126879e6441358a6d6d9f9470be55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/517126879e6441358a6d6d9f9470be55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_517126879e6441358a6d6d9f9470be55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/517126879e6441358a6d6d9f9470be55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-VolumesNegativeTest-1848345604 Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 517126879e6441358a6d6d9f9470be55 Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-VolumesNegativeTest-1848345604 Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-VolumesNegativeTest-1848345604-project Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: ce2b555c8004406d95046b096bcbed1d Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-VolumesNegativeTest-1848345604-project Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 could not be found. Aug 30 12:17:30.320020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '3f8a5917-c478-4119-a6f2-0ce03fd48028'} Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 could not be found. Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:17:30.320932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 could not be found. Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 could not be found. Aug 30 12:17:30.322290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:17:30.323480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] Returning 404 to user: Instance 3f8a5917-c478-4119-a6f2-0ce03fd48028 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:17:30.323480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-92d22edc-d9e2-4e88-a10e-32ca1a390010 tempest-VolumesNegativeTest-1848345604 tempest-VolumesNegativeTest-1848345604-project] 10.222.0.42 "GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028" status: 404 len: 111 microversion: 2.1 time: 0.031854 Aug 30 12:17:30.323480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 522/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:30 2022] GET /compute/v2.1/servers/3f8a5917-c478-4119-a6f2-0ce03fd48028 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:17:41.694017 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:41.694543 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:41.697132 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:41.697784 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:41.702873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:41.703368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:41.703801 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:41.704517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:41.704972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:41.705437 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:41.729219 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-39f6b253-57ba-4270-8ca4-fb58fd815e4b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/ips" status: 200 len: 150 microversion: 2.1 time: 0.039067 Aug 30 12:17:41.729791 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 508/1030] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:17:41 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:44.329256 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38ddc284-7201-4689-bb9e-5cb545b30166"}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:44.331658 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:44.334202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=53 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:17:44.338878 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:44.339356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:44.339787 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:44.340500 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:44.340952 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:44.341369 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:45.080425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f46a6bc5-a2fb-4bfd-a09f-f312c15f2ef6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755210 Aug 30 12:17:45.081029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 523/1031] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:17:44 2022] POST /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:52.684596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38ddc284-7201-4689-bb9e-5cb545b30166"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:52.686926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:52.696480 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:52.696967 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:52.697393 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:52.703544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:52.704324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:52.704780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:52.790408 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Invalid volume: volume 38ddc284-7201-4689-bb9e-5cb545b30166 is already attached to instances: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: POST /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments HTTP/1.1 Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 74 Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:17:52.792166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {"volumeAttachment": {"volumeId": "38ddc284-7201-4689-bb9e-5cb545b30166"}} Aug 30 12:17:52.793809 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Invalid volume: volume 38ddc284-7201-4689-bb9e-5cb545b30166 is already attached to instances: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'server_id': '70d88dbf-62e5-46fb-acd9-8bce8ce4cb53', 'body': {'volumeAttachment': {'volumeId': '38ddc284-7201-4689-bb9e-5cb545b30166'}}} Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 38ddc284-7201-4689-bb9e-5cb545b30166 is already attached to instances: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:17:52.804850 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 38ddc284-7201-4689-bb9e-5cb545b30166 is already attached to instances: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:17:52.806762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 38ddc284-7201-4689-bb9e-5cb545b30166 is already attached to instances: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 400 to user: Invalid volume: volume 38ddc284-7201-4689-bb9e-5cb545b30166 is already attached to instances: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-38ba6673-8c71-4c3e-b4c4-c5fce9313fd1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113095 Aug 30 12:17:52.808428 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 509/1032] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:17:52 2022] POST /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 12:17:52.865548 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:52.866250 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:52.873518 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:52.874077 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:52.874625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:52.876414 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:52.877048 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:52.877488 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:52.977260 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lazy-loading 'services' on Instance uuid 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:17:53.224520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bdb5f2d7-486f-4f7a-923c-9074369f99ad tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments/38ddc284-7201-4689-bb9e-5cb545b30166" status: 202 len: 0 microversion: 2.1 time: 0.363143 Aug 30 12:17:53.225209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 524/1033] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:17:52 2022] DELETE /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments/38ddc284-7201-4689-bb9e-5cb545b30166 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:17:53.235644 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:53.238512 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:53.246888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:53.247378 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:53.248058 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:53.248763 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:53.249221 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:53.249647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:53.281554 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-75ee0dfd-29f6-4158-b0a0-b8162754dfa9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051753 Aug 30 12:17:53.282115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 510/1034] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:17:53 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:54.295348 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:54.298873 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:54.305375 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:54.310174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:54.310174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:54.310174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:54.310174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:54.310880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:54.347751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6b899b50-2940-43fc-9faa-b2263b94fa12 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057267 Aug 30 12:17:54.348373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 525/1035] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:17:54 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:55.362244 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:55.364724 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:55.371643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:55.372269 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:55.372951 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:55.373654 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:55.374112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:55.374537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:55.413304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-842df072-d9b2-4d0f-9397-917b991df96c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056202 Aug 30 12:17:55.413915 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 511/1036] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:17:55 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:17:55.488683 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:55.489997 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:55.498107 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:55.498992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:55.499686 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:55.501410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:55.502109 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:55.502759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:55.534323 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:17:55.762937 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ee0ae4a1-991e-485c-8ac0-d72c506240ce tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 204 len: 0 microversion: 2.1 time: 0.279772 Aug 30 12:17:55.769632 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 526/1037] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:17:55 2022] DELETE /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:17:55.774001 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:55.774861 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:55.794213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:55.796560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:55.797237 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:55.798391 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:55.798856 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:55.799497 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:56.166679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:56.176865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-95249bb8-802e-4abc-befd-3be50209ee93 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1679 microversion: 2.1 time: 0.406852 Aug 30 12:17:56.184684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 512/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:55 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1679 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:57.204350 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:57.206634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:57.215244 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:57.216611 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:57.216611 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:57.217550 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:57.218190 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:57.219001 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:57.434234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:57.445186 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-cd80dac6-9f2b-4791-bf07-39ab19a4a66b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1679 microversion: 2.1 time: 0.245109 Aug 30 12:17:57.459973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 527/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:57 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1679 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:58.477618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:58.478873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:58.490345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:58.490345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:58.490851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:58.491747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:58.492570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:58.493216 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:58.617240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:58.631886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-63e841ed-d68d-408f-9f97-95d6896542eb tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1612 microversion: 2.1 time: 0.158135 Aug 30 12:17:58.633144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 513/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:58 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1612 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:17:58.981002 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-c07746ce-418a-4726-ab41-b5613a4884b0 req-b363405c-3c7e-4fdc-abc2-052adc5ddf73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d88dbf-62e5-46fb-acd9-8bce8ce4cb53", "name": "network-vif-deleted", "tag": "dac372cb-1826-423b-9087-90f68b975142"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:17:59.007528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c07746ce-418a-4726-ab41-b5613a4884b0 req-b363405c-3c7e-4fdc-abc2-052adc5ddf73 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:59.010247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c07746ce-418a-4726-ab41-b5613a4884b0 req-b363405c-3c7e-4fdc-abc2-052adc5ddf73 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:59.012726 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c07746ce-418a-4726-ab41-b5613a4884b0 req-b363405c-3c7e-4fdc-abc2-052adc5ddf73 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:59.087811 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-c07746ce-418a-4726-ab41-b5613a4884b0 req-b363405c-3c7e-4fdc-abc2-052adc5ddf73 service nova] Creating event network-vif-deleted:dac372cb-1826-423b-9087-90f68b975142 for instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 on hv-cinder-83976 Aug 30 12:17:59.096393 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-c07746ce-418a-4726-ab41-b5613a4884b0 req-b363405c-3c7e-4fdc-abc2-052adc5ddf73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118952 Aug 30 12:17:59.099493 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 528/1041] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:17:59.654986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:17:59.655631 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:17:59.663172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:59.664376 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:59.665560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:59.667488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:59.672728 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:59.675169 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:59.723981 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:17:59.725270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:17:59.726206 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:17:59.727185 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lazy-loading 'fault' on Instance uuid 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:17:59.878155 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:17:59.907997 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-708027b7-328a-4e51-8d25-57e5fa211100 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 200 len: 1329 microversion: 2.1 time: 0.257032 Aug 30 12:17:59.908903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 514/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:17:59 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 1329 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:00.931729 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:00.933237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:00.940460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:00.941170 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:00.941815 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:00.942516 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:00.942963 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:00.943564 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:00.963866 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 HTTP/1.1 Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:18:00.965578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:18:00.967247 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '70d88dbf-62e5-46fb-acd9-8bce8ce4cb53'} Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:18:00.968221 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:18:00.970522 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:00.972809 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:18:00.974195 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-1d5c7be9-3294-410d-8e2d-619c7a63fa70 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 404 len: 111 microversion: 2.1 time: 0.048028 Aug 30 12:18:00.979699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 529/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:00 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:18:00.985646 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-37c39f3e-29d5-45bd-9a8e-4a51f7393701 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '.version_select at 0x7efe4ed8fca0>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:01.071676 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-37c39f3e-29d5-45bd-9a8e-4a51f7393701 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-68482513" status: 202 len: 0 microversion: 2.1 time: 0.092116 Aug 30 12:18:01.080987 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 515/1044] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Aug 30 12:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-68482513 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:18:01.499978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-d6579d0e-a64c-4811-b501-9babb0acf4c2 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Action: 'create', calling method: .version_select at 0x7efe4ec36b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1828409437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwSkIxKXR6RY0boGep7ynPzWqKl9wnwytjcu9C6JwvDno8Ya16lBT2PyYfwfCZmoyhOv3NYHynCAL7E9G4VVpuA6rnT0M8ug9TwiNSMSBN1pZ966HY/YXKKgcr53bfIXA=="}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:01.516827 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-d6579d0e-a64c-4811-b501-9babb0acf4c2 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Getting quotas for project 73e12097423d476a84a6f0dd7e83fe06. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:18:01.521278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-d6579d0e-a64c-4811-b501-9babb0acf4c2 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Getting quotas for user de686f2ada0647399fecfc50b41c8120 and project 73e12097423d476a84a6f0dd7e83fe06. Resources: {'key_pairs'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:18:01.599487 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-d6579d0e-a64c-4811-b501-9babb0acf4c2 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.365678 Aug 30 12:18:01.600316 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 530/1045] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:18:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:02.271976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9cee081d-c029-4864-853a-6616d4d12b8b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: .version_select at 0x7efe4ef5ad30>, body: {"keypair": {"name": "tempest-keypair-576187228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTFksN14eCJJmnbs6qmx0hDPHaC4jLtdZkFI2W0nErFabMsNoWF8YwWasXmRNtRVtDH92Oh6SgTZE0OJAb1m+Xkn6Nda1mVK2ezToe+LIrgwBy9NZvhduZRul05NYTJpw=="}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:02.290351 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:02.291767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:02.294028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-9cee081d-c029-4864-853a-6616d4d12b8b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:18:02.298543 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-9cee081d-c029-4864-853a-6616d4d12b8b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'key_pairs'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:18:02.300257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:02.300949 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:02.301542 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:02.302448 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:02.303067 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:02.303648 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:02.334676 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:18:02.398447 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9cee081d-c029-4864-853a-6616d4d12b8b tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129988 Aug 30 12:18:02.399636 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 516/1046] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Aug 30 12:18:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:02.404842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-10f94232-b304-42c1-bb4c-6e6ca4961f3b req-10387acd-84a6-4230-bf14-c214987ca7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4a2abc-6f16-4ada-9c90-059d88bac50f", "tag": "f7343819-b8c6-453c-a9a4-b895882763d1"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:02.416511 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-10f94232-b304-42c1-bb4c-6e6ca4961f3b req-10387acd-84a6-4230-bf14-c214987ca7b3 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:02.417078 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-10f94232-b304-42c1-bb4c-6e6ca4961f3b req-10387acd-84a6-4230-bf14-c214987ca7b3 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:02.417585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-10f94232-b304-42c1-bb4c-6e6ca4961f3b req-10387acd-84a6-4230-bf14-c214987ca7b3 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:02.430887 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-10f94232-b304-42c1-bb4c-6e6ca4961f3b req-10387acd-84a6-4230-bf14-c214987ca7b3 service nova] Creating event network-changed:f7343819-b8c6-453c-a9a4-b895882763d1 for instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f on hv-cinder-83976 Aug 30 12:18:02.438860 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-10f94232-b304-42c1-bb4c-6e6ca4961f3b req-10387acd-84a6-4230-bf14-c214987ca7b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034917 Aug 30 12:18:02.438860 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 517/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:02.693389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e75daf38-5c87-417d-acaa-051b2c84bb75 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 204 len: 0 microversion: 2.1 time: 0.405835 Aug 30 12:18:02.697934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 531/1048] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:18:02 2022] DELETE /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 12:18:02.707293 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:02.707920 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:02.714359 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:02.717111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:02.717544 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:02.718249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:02.727886 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:02.728548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:02.897172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:02.912306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a055f4fa-3e6e-482e-ba7e-f519c1d46ff9 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1576 microversion: 2.1 time: 0.209744 Aug 30 12:18:02.913904 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 518/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:02 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:03.936543 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:03.937760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:03.944888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:03.945489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:03.946021 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:03.946880 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:03.947404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:03.952020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:04.320539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:04.331029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0a1cd7a6-238c-4ee0-82dc-b56b4c3b9000 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1576 microversion: 2.1 time: 0.398791 Aug 30 12:18:04.333202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 532/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:03 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1576 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:05.355100 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:05.355732 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:05.363799 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:05.365343 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:05.365792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:05.366507 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:05.367144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:05.368256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:05.441829 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:05.452972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3e4e0b3a-f6e5-459b-b435-e5a543dd6887 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1390 microversion: 2.1 time: 0.102515 Aug 30 12:18:05.467426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 519/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:05 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1390 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:05.560742 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-d351efff-c802-44be-813c-c2d26ab3912b req-1faf3c0b-a198-47aa-91a8-a67b3fea2130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4a2abc-6f16-4ada-9c90-059d88bac50f", "name": "network-vif-deleted", "tag": "f7343819-b8c6-453c-a9a4-b895882763d1"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:05.585491 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d351efff-c802-44be-813c-c2d26ab3912b req-1faf3c0b-a198-47aa-91a8-a67b3fea2130 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:05.585973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d351efff-c802-44be-813c-c2d26ab3912b req-1faf3c0b-a198-47aa-91a8-a67b3fea2130 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:05.586405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-d351efff-c802-44be-813c-c2d26ab3912b req-1faf3c0b-a198-47aa-91a8-a67b3fea2130 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:05.599298 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-d351efff-c802-44be-813c-c2d26ab3912b req-1faf3c0b-a198-47aa-91a8-a67b3fea2130 service nova] Creating event network-vif-deleted:f7343819-b8c6-453c-a9a4-b895882763d1 for instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f on hv-cinder-83976 Aug 30 12:18:05.607365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-d351efff-c802-44be-813c-c2d26ab3912b req-1faf3c0b-a198-47aa-91a8-a67b3fea2130 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049908 Aug 30 12:18:05.608006 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 533/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:05.738499 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-829263867", "imageRef": "d1faf0f9-97f3-41cb-9c23-4257a72fbf0c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5440e9-8593-4ddc-a45f-ad471b8efbac"}], "security_groups": [{"name": "tempest-securitygroup--2027563589"}], "key_name": "tempest-keypair-576187228", "user_data": "}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:05.897532 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.network.neutron [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] validate_networks() for [('4d5440e9-8593-4ddc-a45f-ad471b8efbac', None, None, None, None, None)] {{(pid=121192) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:18:06.349430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:18:06.349851 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image limits 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:18:06.350419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Flavor pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:18:06.350880 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Image pref 0:0:0 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:18:06.351287 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.virt.hardware [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:18:06.360675 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:06.361270 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:06.361584 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:06.362568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:06.363017 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:06.363579 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:06.385424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:18:06.389893 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.quota [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Getting quotas for user 5074689cd41c4bf0b47056ea436a609a and project 716103ef37a64f53ab58ec2a9b1a24e1. Resources: {'instances', 'cores', 'ram'} {{(pid=121192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:18:06.404055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Going to run 1 instances... {{(pid=121192) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:18:06.407126 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1faf0f9-97f3-41cb-9c23-4257a72fbf0c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:18:06.476032 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:06.476848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:06.483479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:06.483996 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:06.485196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:06.485923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:06.486382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:06.487058 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:06.502905 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2a81c101-22f9-453a-b996-299e20e59b5f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.769907 Aug 30 12:18:06.503565 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 520/1053] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:18:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:18:06.515015 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1239c6c7-cd67-4142-a4f4-540455b3f6c8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:06.515818 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-1239c6c7-cd67-4142-a4f4-540455b3f6c8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:06.525310 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:06.525777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:06.526294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:06.526699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lazy-loading 'fault' on Instance uuid 9f4a2abc-6f16-4ada-9c90-059d88bac50f {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:18:06.576445 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:06.586730 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-1239c6c7-cd67-4142-a4f4-540455b3f6c8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:06.591624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-008f0381-5fd0-4293-b7a3-8dcc8d5346e5 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 200 len: 1230 microversion: 2.1 time: 0.119939 Aug 30 12:18:06.592234 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 534/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:06 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:18:06.596746 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1239c6c7-cd67-4142-a4f4-540455b3f6c8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1240 microversion: 2.1 time: 0.083347 Aug 30 12:18:06.596746 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 521/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:06 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:07.620048 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:07.620724 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:07.621091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 9f4a2abc-6f16-4ada-9c90-059d88bac50f] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:07.621191 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:07.631864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:07.632076 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:07.632661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:07.632777 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:07.633352 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:07.633504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:07.634482 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:07.634601 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:07.635216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:07.635325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:07.635907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:07.636054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:07.666159 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] HTTP exception thrown: Instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f could not be found. Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Request method failure captured: Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f HTTP/1.1 Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf4RXHcRQfA68tpXAfIkGgPGX3tSrBs-sbTzpWnNEQyofEKC5kitEEOoNVI4IWbmKc0g3wWPO68UDRfQ5Zyfb9AgnI-fxYAs-8aYWbkRa6zFKWiY39eO0B5WtU3x984eIMtYdio0C5O9HsSe3PBR2pDtLrqfFrDhNGQG1nyTJhYDHP4 Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:18:07.669258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 3733f8f0d14746949cbe92c9d370c33e Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f could not be found. Aug 30 12:18:07.670703 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '9f4a2abc-6f16-4ada-9c90-059d88bac50f'} Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f could not be found. Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:18:07.671501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f could not be found. Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f could not be found. Aug 30 12:18:07.674336 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:07.675934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Returning 404 to user: Instance 9f4a2abc-6f16-4ada-9c90-059d88bac50f could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:18:07.675934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e29181e2-415c-483c-b7a9-3fb0daafc51b tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f" status: 404 len: 111 microversion: 2.1 time: 0.058031 Aug 30 12:18:07.675934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 535/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:07 2022] GET /compute/v2.1/servers/9f4a2abc-6f16-4ada-9c90-059d88bac50f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:18:07.724244 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:07.739989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c4bba405-4e51-4dc7-acc6-1102dde32a89 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1244 microversion: 2.1 time: 0.119215 Aug 30 12:18:07.739989 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 522/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:07 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:08.759081 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:08.760502 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:08.768821 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:08.769305 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:08.769733 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:08.770430 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:08.770915 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:08.771498 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:08.862922 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:08.871278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-62fba04d-815e-4e5f-b5a4-565b012d6d61 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1300 microversion: 2.1 time: 0.119497 Aug 30 12:18:08.871667 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 536/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:08 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:09.898533 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:09.899443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:09.906509 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:09.907376 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:09.908104 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:09.909069 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:09.909731 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:09.910360 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:10.053789 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:10.068674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d109a50a-8c9c-4fff-af85-6368f438d2e8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1366 microversion: 2.1 time: 0.176928 Aug 30 12:18:10.069249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 523/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:09 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:10.435848 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-08c0ad22-9b6c-4498-9242-bb268168311c req-b3c1dd70-913d-426f-b83b-81bf34f2e763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488316a3-1995-4da7-b8d5-0519c35a75b1", "tag": "822cd088-1a2b-407e-aee5-0b40df2dfa41"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:10.447629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-08c0ad22-9b6c-4498-9242-bb268168311c req-b3c1dd70-913d-426f-b83b-81bf34f2e763 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:10.448529 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-08c0ad22-9b6c-4498-9242-bb268168311c req-b3c1dd70-913d-426f-b83b-81bf34f2e763 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:10.449163 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-08c0ad22-9b6c-4498-9242-bb268168311c req-b3c1dd70-913d-426f-b83b-81bf34f2e763 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:10.462071 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-08c0ad22-9b6c-4498-9242-bb268168311c req-b3c1dd70-913d-426f-b83b-81bf34f2e763 service nova] Creating event network-changed:822cd088-1a2b-407e-aee5-0b40df2dfa41 for instance 488316a3-1995-4da7-b8d5-0519c35a75b1 on hv-cinder-83976 Aug 30 12:18:10.466971 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-08c0ad22-9b6c-4498-9242-bb268168311c req-b3c1dd70-913d-426f-b83b-81bf34f2e763 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034892 Aug 30 12:18:10.470911 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 537/1060] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:11.093476 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:11.094956 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:11.102306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:11.103120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:11.103735 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:11.104519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:11.104978 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:11.105431 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:11.347363 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:11.360244 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3e081037-f696-49cd-a2b4-db6e26b92be8 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1366 microversion: 2.1 time: 0.270127 Aug 30 12:18:11.360834 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 524/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:11 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:11.493964 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:11.494552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:11.495295 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-5fe069cc-b1b1-4347-bdee-fe0adf72cec6 req-afb6aa36-614f-4ac9-b2b9-f779cdc2c6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07", "tag": "434c6abc-e73a-47b5-8fda-e567642152ab"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:11.508110 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:11.515365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:11.515365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:11.515595 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-5fe069cc-b1b1-4347-bdee-fe0adf72cec6 req-afb6aa36-614f-4ac9-b2b9-f779cdc2c6ef service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:11.515711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:11.515800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-5fe069cc-b1b1-4347-bdee-fe0adf72cec6 req-afb6aa36-614f-4ac9-b2b9-f779cdc2c6ef service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:11.515893 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:11.516009 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-5fe069cc-b1b1-4347-bdee-fe0adf72cec6 req-afb6aa36-614f-4ac9-b2b9-f779cdc2c6ef service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:11.516096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:11.522976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-5fe069cc-b1b1-4347-bdee-fe0adf72cec6 req-afb6aa36-614f-4ac9-b2b9-f779cdc2c6ef service nova] Creating event network-changed:434c6abc-e73a-47b5-8fda-e567642152ab for instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 on hv-cinder-83976 Aug 30 12:18:11.528500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-5fe069cc-b1b1-4347-bdee-fe0adf72cec6 req-afb6aa36-614f-4ac9-b2b9-f779cdc2c6ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036918 Aug 30 12:18:11.529751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 525/1062] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:11.536892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:11.537961 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=4 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:11.545908 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:18:11.865049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-86e4675a-3ed5-4ba4-b992-95b996468b97 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 204 len: 0 microversion: 2.1 time: 0.375521 Aug 30 12:18:11.865634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 538/1063] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:18:11 2022] DELETE /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:18:11.874508 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:11.875206 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:11.881528 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:11.882016 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:11.882445 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:11.883134 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:11.883585 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:11.884037 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:12.030987 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:12.036618 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-ac682c46-bca9-47d1-aab6-e4d357b98f62 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1576 microversion: 2.1 time: 0.166205 Aug 30 12:18:12.037279 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 526/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:11 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:18:12.382639 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:12.383344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:12.390213 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:12.391390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:12.391906 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:12.392838 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:12.393387 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:12.393835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:12.606072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:12.614585 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4132c6db-146d-43d6-a348-735adbb32eb7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1366 microversion: 2.1 time: 0.236379 Aug 30 12:18:12.615152 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 539/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:12 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:13.062012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:13.062626 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:13.069465 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:13.069983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:13.070415 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:13.071106 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:13.071557 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:13.072005 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:13.210122 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:13.217852 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9992a8e8-bce4-490a-a4e6-38dfd1f3087a tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1576 microversion: 2.1 time: 0.162101 Aug 30 12:18:13.219031 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 527/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:13 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:13.636387 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:13.636993 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:13.644359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:13.644840 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:13.645271 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:13.645959 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:13.646480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:13.646902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:13.865951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:13.874189 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-aca5b132-ea6b-4f12-9b70-4603e1b09b33 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1366 microversion: 2.1 time: 0.241418 Aug 30 12:18:13.888032 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 540/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:13 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:14.245070 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:14.245683 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:14.253881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:14.254400 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:14.254832 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:14.255522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:14.255994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:14.256421 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:14.401653 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:14.411230 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-050253dc-1711-49f3-af8c-217fa6fd8be8 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1576 microversion: 2.1 time: 0.169959 Aug 30 12:18:14.412351 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 528/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:14 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:14.895649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:14.896390 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:14.899055 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:14.903793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:14.904346 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:14.904717 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:14.905407 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:14.905853 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:14.906268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:14.917513 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-e9eb50dd-7fc2-48e6-be7c-b1c8bb85532e req-97276d5f-7428-4444-898a-71ebec1972e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07", "name": "network-vif-deleted", "tag": "434c6abc-e73a-47b5-8fda-e567642152ab"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:14.928302 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-e9eb50dd-7fc2-48e6-be7c-b1c8bb85532e req-97276d5f-7428-4444-898a-71ebec1972e6 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:14.928790 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-e9eb50dd-7fc2-48e6-be7c-b1c8bb85532e req-97276d5f-7428-4444-898a-71ebec1972e6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:14.929217 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-e9eb50dd-7fc2-48e6-be7c-b1c8bb85532e req-97276d5f-7428-4444-898a-71ebec1972e6 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:14.941725 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-e9eb50dd-7fc2-48e6-be7c-b1c8bb85532e req-97276d5f-7428-4444-898a-71ebec1972e6 service nova] Creating event network-vif-deleted:434c6abc-e73a-47b5-8fda-e567642152ab for instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 on hv-cinder-83976 Aug 30 12:18:14.947202 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-e9eb50dd-7fc2-48e6-be7c-b1c8bb85532e req-97276d5f-7428-4444-898a-71ebec1972e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033143 Aug 30 12:18:14.948083 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 529/1069] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:18:15.050034 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:15.057595 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4cfe911d-f03f-425b-adcc-7bf00c0443c0 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1366 microversion: 2.1 time: 0.166786 Aug 30 12:18:15.058171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 541/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:14 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:15.433907 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:15.434647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:15.441647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:15.442510 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:15.442627 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:15.443359 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:15.443853 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:15.444358 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:15.448602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=100 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:15.628999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3733f8f0d14746949cbe92c9d370c33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec4d079d6524a0db40e8a055fbd4d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:15.637146 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4a79b1fe-bd0c-4ada-a14a-babe153166c6 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 200 len: 1226 microversion: 2.1 time: 0.208088 Aug 30 12:18:15.643105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 530/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:15 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 1226 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:16.063759 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-086bd185-8006-4662-adfb-11639d5789e1 req-a24187fd-bb02-4047-8400-87bc7c40a79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488316a3-1995-4da7-b8d5-0519c35a75b1", "name": "network-vif-plugged", "status": "completed", "tag": "822cd088-1a2b-407e-aee5-0b40df2dfa41"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:16.073816 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-086bd185-8006-4662-adfb-11639d5789e1 req-a24187fd-bb02-4047-8400-87bc7c40a79b service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:16.076062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-086bd185-8006-4662-adfb-11639d5789e1 req-a24187fd-bb02-4047-8400-87bc7c40a79b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:16.076062 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-086bd185-8006-4662-adfb-11639d5789e1 req-a24187fd-bb02-4047-8400-87bc7c40a79b service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:16.079218 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:16.079823 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:16.086140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:16.086623 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:16.086748 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-086bd185-8006-4662-adfb-11639d5789e1 req-a24187fd-bb02-4047-8400-87bc7c40a79b service nova] Creating event network-vif-plugged:822cd088-1a2b-407e-aee5-0b40df2dfa41 for instance 488316a3-1995-4da7-b8d5-0519c35a75b1 on hv-cinder-83976 Aug 30 12:18:16.087054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:16.087740 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:16.088221 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:16.088692 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:16.091602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-086bd185-8006-4662-adfb-11639d5789e1 req-a24187fd-bb02-4047-8400-87bc7c40a79b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032136 Aug 30 12:18:16.092427 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 542/1072] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:16.257397 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:16.265212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a4de205d-f8ed-4eb8-a4b5-3927b29bf180 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1366 microversion: 2.1 time: 0.189957 Aug 30 12:18:16.265857 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 531/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:16 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:18:16.659631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:16.660303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:16.666745 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:16.667237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:16.667671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:16.668396 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:16.668876 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:16.669297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:16.682512 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] HTTP exception thrown: Instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 could not be found. Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Request method failure captured: Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 HTTP/1.1 Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf4RXHcRQfA68tpXAfIkGgPGX3tSrBs-sbTzpWnNEQyofEKC5kitEEOoNVI4IWbmKc0g3wWPO68UDRfQ5Zyfb9AgnI-fxYAs-8aYWbkRa6zFKWiY39eO0B5WtU3x984eIMtYdio0C5O9HsSe3PBR2pDtLrqfFrDhNGQG1nyTJhYDHP4 Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:18:16.684200 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 3733f8f0d14746949cbe92c9d370c33e Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 could not be found. Aug 30 12:18:16.685978 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07'} Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 could not be found. Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:18:16.686803 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 could not be found. Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 could not be found. Aug 30 12:18:16.688716 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:16.689963 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Returning 404 to user: Instance fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:18:16.689963 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8f869c49-ba2d-4b07-964d-c9255fb1a3aa tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07" status: 404 len: 111 microversion: 2.1 time: 0.030439 Aug 30 12:18:16.689963 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 543/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:16 2022] GET /compute/v2.1/servers/fe7d6fdd-7200-4810-b2bf-3a8ba3da0b07 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:18:17.201504 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:17.204759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:17.204759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:17.205777 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=12 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:17.210537 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:17.211030 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:17.211470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:17.212196 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:17.212699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:17.213131 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:17.226624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] HTTP exception thrown: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Request method failure captured: Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: DELETE /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e HTTP/1.1 Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf4RXHcRQfA68tpXAfIkGgPGX3tSrBs-sbTzpWnNEQyofEKC5kitEEOoNVI4IWbmKc0g3wWPO68UDRfQ5Zyfb9AgnI-fxYAs-8aYWbkRa6zFKWiY39eO0B5WtU3x984eIMtYdio0C5O9HsSe3PBR2pDtLrqfFrDhNGQG1nyTJhYDHP4 Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:18:17.228330 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 3733f8f0d14746949cbe92c9d370c33e Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.229990 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '423f83c5-b199-43bd-a57f-0c208ac1c44e'} Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:18:17.230889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.232385 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.233897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Returning 404 to user: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:18:17.233897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5824448d-0b2e-4b79-baed-e2cca5ab35fc tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "DELETE /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 404 len: 111 microversion: 2.1 time: 0.032090 Aug 30 12:18:17.233897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 532/1075] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:18:17 2022] DELETE /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:18:17.239633 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:17.240312 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] [instance: 423f83c5-b199-43bd-a57f-0c208ac1c44e] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:17.246884 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:17.247367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:17.247801 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:17.248517 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:17.249009 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:17.254927 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:17.263469 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] HTTP exception thrown: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Request method failure captured: Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e HTTP/1.1 Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf4RXHcRQfA68tpXAfIkGgPGX3tSrBs-sbTzpWnNEQyofEKC5kitEEOoNVI4IWbmKc0g3wWPO68UDRfQ5Zyfb9AgnI-fxYAs-8aYWbkRa6zFKWiY39eO0B5WtU3x984eIMtYdio0C5O9HsSe3PBR2pDtLrqfFrDhNGQG1nyTJhYDHP4 Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:18:17.265073 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cec4d079d6524a0db40e8a055fbd4d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: cec4d079d6524a0db40e8a055fbd4d9c Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-TestVolumeBootPattern-2139081409 Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 3733f8f0d14746949cbe92c9d370c33e Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-TestVolumeBootPattern-2139081409-project Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.266721 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '423f83c5-b199-43bd-a57f-0c208ac1c44e'} Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:18:17.267575 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. Aug 30 12:18:17.268897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:18:17.270030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Returning 404 to user: Instance 423f83c5-b199-43bd-a57f-0c208ac1c44e could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:18:17.270030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a5f137e5-b3f9-49e2-a6bf-889320e8be03 tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e" status: 404 len: 111 microversion: 2.1 time: 0.031919 Aug 30 12:18:17.270030 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 544/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:17 2022] GET /compute/v2.1/servers/423f83c5-b199-43bd-a57f-0c208ac1c44e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:18:17.287763 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:17.289345 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:17.294643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:17.295121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:17.295550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:17.296306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:17.296755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:17.297173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:17.432651 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:17.440245 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c0eb743e-44cf-4232-8d80-b4e40e42f28e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1366 microversion: 2.1 time: 0.156641 Aug 30 12:18:17.440816 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 533/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:17 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:18.462734 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:18.463261 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:18.470967 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:18.471442 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:18.471871 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:18.472595 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:18.473100 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:18.473583 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:18.627332 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:18.635405 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-fd47bff5-442a-445b-89de-ff52d9a976e6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1556 microversion: 2.1 time: 0.176656 Aug 30 12:18:18.636063 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 545/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:18 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:18:18.664378 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:18.665036 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:18.671130 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:18.671815 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:18.672427 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:18.673087 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:18.673550 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:18.673944 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:18.750972 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-662015d2-f1f7-484f-9cab-4bab6199d92a tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090552 Aug 30 12:18:18.751558 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 534/1079] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Aug 30 12:18:18 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:18.784093 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a61f390f-ae42-42fb-8a77-418281ee515d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] Calling method '.version_select at 0x7efe4ef9db80>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:18.854303 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a61f390f-ae42-42fb-8a77-418281ee515d tempest-TestVolumeBootPattern-2139081409 tempest-TestVolumeBootPattern-2139081409-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1243030642" status: 202 len: 0 microversion: 2.1 time: 0.074344 Aug 30 12:18:18.854976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 546/1080] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Aug 30 12:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1243030642 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:18:19.793470 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-96c38c65-1098-412b-8408-b57111c10726 req-55c2af40-a91b-4637-8dd4-490a936450dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488316a3-1995-4da7-b8d5-0519c35a75b1", "tag": "822cd088-1a2b-407e-aee5-0b40df2dfa41"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:19.803595 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-96c38c65-1098-412b-8408-b57111c10726 req-55c2af40-a91b-4637-8dd4-490a936450dc service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:19.804028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-96c38c65-1098-412b-8408-b57111c10726 req-55c2af40-a91b-4637-8dd4-490a936450dc service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:19.804462 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-96c38c65-1098-412b-8408-b57111c10726 req-55c2af40-a91b-4637-8dd4-490a936450dc service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:19.816357 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-96c38c65-1098-412b-8408-b57111c10726 req-55c2af40-a91b-4637-8dd4-490a936450dc service nova] Creating event network-changed:822cd088-1a2b-407e-aee5-0b40df2dfa41 for instance 488316a3-1995-4da7-b8d5-0519c35a75b1 on hv-cinder-83976 Aug 30 12:18:19.821326 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-96c38c65-1098-412b-8408-b57111c10726 req-55c2af40-a91b-4637-8dd4-490a936450dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 Aug 30 12:18:19.821912 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 535/1081] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:18:20.739339 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1785615022", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1828409437", "security_groups": [{"name": "tempest-secgroup-smoke-1012564679"}], "networks": [{"uuid": "eee3a1f7-f4d1-4f7c-ae0b-003dd0a12495"}], "block_device_mapping_v2": [{"uuid": "bcd8e148-6fb0-435f-870f-2933a8d513a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:21.113580 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.network.neutron [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] validate_networks() for [('eee3a1f7-f4d1-4f7c-ae0b-003dd0a12495', None, None, None, None, None)] {{(pid=121191) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 12:18:21.530582 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Flavor limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 12:18:21.531643 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Image limits 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 12:18:21.533258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Flavor pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 12:18:21.533389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Image pref 0:0:0 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 12:18:21.533708 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.virt.hardware [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121191) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 12:18:21.543505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:21.543782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:21.544261 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:21.544988 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:21.545440 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:21.545861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:21.565329 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Getting quotas for project 73e12097423d476a84a6f0dd7e83fe06. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 12:18:21.569449 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.quota [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Getting quotas for user de686f2ada0647399fecfc50b41c8120 and project 73e12097423d476a84a6f0dd7e83fe06. Resources: {'instances', 'cores', 'ram'} {{(pid=121191) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 12:18:21.633520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Going to run 1 instances... {{(pid=121191) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 12:18:21.635802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcd8e148-6fb0-435f-870f-2933a8d513a7',volume_size=None,volume_type=None)] {{(pid=121191) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 12:18:22.108802 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-68fd2de9-9ec6-417d-9022-9bda04f6fed4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.376418 Aug 30 12:18:22.109471 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 547/1082] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Aug 30 12:18:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 12:18:22.122178 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-990f11b0-fb55-4274-9415-14da09cd2bef tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:22.122881 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-990f11b0-fb55-4274-9415-14da09cd2bef tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:22.184489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-990f11b0-fb55-4274-9415-14da09cd2bef tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:22.196466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-990f11b0-fb55-4274-9415-14da09cd2bef tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1089 microversion: 2.1 time: 0.079087 Aug 30 12:18:22.197450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 536/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:22 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:23.218079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:23.218524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:23.225847 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:23.226382 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:23.227259 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:23.228028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:23.228504 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:23.228924 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:23.293266 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:23.301028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-a415594e-6ca5-43d1-997e-88744dfa37b4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1139 microversion: 2.1 time: 0.087655 Aug 30 12:18:23.301599 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 548/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:23 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:24.322819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:24.322819 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:24.326865 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:24.336298 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:24.336794 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:24.337240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:24.337929 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:24.338383 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:24.338842 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:24.412882 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:24.422025 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cec11970-d626-41af-9648-2cc9c4568354 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1195 microversion: 2.1 time: 0.104413 Aug 30 12:18:24.424123 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 537/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:24 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1195 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:25.446113 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:25.447459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:25.457186 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:25.458054 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:25.459292 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:25.460270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:25.460950 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:25.461747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:25.775776 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:25.784973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-e6f6fbe3-9eb8-4409-a0e6-36c2c0e485cd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1273 microversion: 2.1 time: 0.343760 Aug 30 12:18:25.785768 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 549/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:25 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:26.654672 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-ca4969fa-0b9b-46a8-8e80-ea1ad470c1a7 req-e90edbc4-c417-411c-af0f-56489523a880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549a64e4-c815-401b-a11b-20bb6e4ae5be", "tag": "0d26be27-92ac-4eef-84db-d207e3a196d3"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:26.665796 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-ca4969fa-0b9b-46a8-8e80-ea1ad470c1a7 req-e90edbc4-c417-411c-af0f-56489523a880 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:26.666360 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-ca4969fa-0b9b-46a8-8e80-ea1ad470c1a7 req-e90edbc4-c417-411c-af0f-56489523a880 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:26.666897 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-ca4969fa-0b9b-46a8-8e80-ea1ad470c1a7 req-e90edbc4-c417-411c-af0f-56489523a880 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:26.679140 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-ca4969fa-0b9b-46a8-8e80-ea1ad470c1a7 req-e90edbc4-c417-411c-af0f-56489523a880 service nova] Creating event network-changed:0d26be27-92ac-4eef-84db-d207e3a196d3 for instance 549a64e4-c815-401b-a11b-20bb6e4ae5be on hv-cinder-83976 Aug 30 12:18:26.685321 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-ca4969fa-0b9b-46a8-8e80-ea1ad470c1a7 req-e90edbc4-c417-411c-af0f-56489523a880 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131975 Aug 30 12:18:26.686679 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 538/1087] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:26.808528 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:26.809829 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:26.816884 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:26.817362 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:26.817792 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:26.818487 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:26.819104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:26.819625 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:27.140932 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:27.149591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-08206a21-ae8f-43b3-9e97-ab2b6dcdf364 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.345903 Aug 30 12:18:27.150169 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 550/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:26 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:28.173129 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:28.173702 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:28.180176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:28.180655 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:28.181086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:28.181771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:28.182220 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:28.182660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:28.316873 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:28.325511 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cc74f663-4663-45f4-9a5b-f95ac86bcd31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.157807 Aug 30 12:18:28.332115 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 539/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:28 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:18:29.349835 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:29.350444 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:29.356751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:29.357209 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:29.357634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:29.358312 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:29.358760 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:29.359184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:29.493631 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:29.501894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3b991e7b-eafb-4972-8aca-0c64e1b8782b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.156011 Aug 30 12:18:29.502480 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 551/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:29 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:30.522825 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:30.523430 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:30.530095 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:30.530579 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:30.531012 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:30.531762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:30.532325 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:30.532778 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:30.668240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:30.676433 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-23af7a5c-7580-4bac-be8b-9d1b2cd1eb01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.157434 Aug 30 12:18:30.676992 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 540/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:30 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:31.697240 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:31.697856 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:31.700239 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:31.700900 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell0:SELECT=6 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:31.705604 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:31.706079 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:31.706506 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:31.707184 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:31.707635 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:31.708078 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:31.837342 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:31.845486 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f9ede199-be57-428a-80b9-6440fd798186 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.152110 Aug 30 12:18:31.846028 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 552/1092] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:31 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:32.866555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:32.867206 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:32.869660 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell0:SELECT=2 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:32.874563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:32.875042 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:32.876307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:32.877124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:32.877590 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:32.878013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:33.011186 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:33.019775 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-fcce9b12-b317-4991-a1d4-c97a2100d007 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.157345 Aug 30 12:18:33.020522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 541/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:32 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:34.046162 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:34.046718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:34.053133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:34.053613 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:34.054049 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:34.054744 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:34.055187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:34.055609 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:34.186321 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:34.194610 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dc77188b-2f54-4fe2-9306-7da086350618 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.152475 Aug 30 12:18:34.195183 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 553/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:34 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:35.216281 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:35.216938 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:35.223940 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:35.224446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:35.224869 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:35.225546 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:35.225999 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:35.226418 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:35.354954 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:35.363352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bbb553ec-bd8b-4a4f-8f1a-36c3fa0ed1e7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.150995 Aug 30 12:18:35.363914 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 542/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:35 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:36.384489 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:36.385057 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:36.391713 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:36.392343 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:36.392782 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:36.393471 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:36.393923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:36.394347 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:36.530514 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:36.538307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-292d83fd-7497-4b34-8be1-c3d354857c43 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.157746 Aug 30 12:18:36.538890 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 554/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:36 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:37.559065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:37.559678 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:37.566826 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:37.567307 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:37.567739 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:37.568447 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:37.568901 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:37.569324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:37.704569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:37.712484 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c6bf59b8-93f3-4324-9f6a-470eec3474c5 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.157300 Aug 30 12:18:37.713096 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 543/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:37 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:38.266825 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-c224b0c9-f80b-4c5b-89ac-95d0ec8ca78e req-25ad1d6b-3ce5-4a03-884f-4d13543752f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549a64e4-c815-401b-a11b-20bb6e4ae5be", "name": "network-vif-plugged", "status": "completed", "tag": "0d26be27-92ac-4eef-84db-d207e3a196d3"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:38.276956 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c224b0c9-f80b-4c5b-89ac-95d0ec8ca78e req-25ad1d6b-3ce5-4a03-884f-4d13543752f5 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:38.277432 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c224b0c9-f80b-4c5b-89ac-95d0ec8ca78e req-25ad1d6b-3ce5-4a03-884f-4d13543752f5 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:38.277861 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c224b0c9-f80b-4c5b-89ac-95d0ec8ca78e req-25ad1d6b-3ce5-4a03-884f-4d13543752f5 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:38.289441 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-c224b0c9-f80b-4c5b-89ac-95d0ec8ca78e req-25ad1d6b-3ce5-4a03-884f-4d13543752f5 service nova] Creating event network-vif-plugged:0d26be27-92ac-4eef-84db-d207e3a196d3 for instance 549a64e4-c815-401b-a11b-20bb6e4ae5be on hv-cinder-83976 Aug 30 12:18:38.294707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-c224b0c9-f80b-4c5b-89ac-95d0ec8ca78e req-25ad1d6b-3ce5-4a03-884f-4d13543752f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 Aug 30 12:18:38.295126 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 555/1098] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:38.733759 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:38.734394 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:38.742007 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:38.742492 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:38.742930 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:38.743625 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:38.744143 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:38.744578 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:38.880138 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:38.887795 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3237c95c-fc49-486e-9f48-3010f061f01e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.157923 Aug 30 12:18:38.888382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 544/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:38 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:18:39.910523 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:39.911215 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:39.917363 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:39.917840 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:39.918278 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:39.918959 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:39.919410 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:39.919832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:40.052573 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:40.060423 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0c191c8d-81c0-420c-b9f4-1a0f5d8097ec tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1261 microversion: 2.1 time: 0.155065 Aug 30 12:18:40.060988 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 556/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:39 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:41.081079 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:41.081699 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:41.088121 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:41.088606 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:41.089040 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:41.089723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:41.090179 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:41.090603 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:41.222309 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:41.229976 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-d23ae2a9-60fc-43b1-9ea0-d1a1acd61ccd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1445 microversion: 2.1 time: 0.152843 Aug 30 12:18:41.230536 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 545/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:41 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:41.251484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:41.252125 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:41.258064 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:41.258545 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:41.258982 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:41.259682 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:41.260174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:41.260711 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:41.280699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:41.392373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:18:41.399992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b4b63e44-ba7c-41ae-b58f-5ec107c44038 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1445 microversion: 2.1 time: 0.153265 Aug 30 12:18:41.400554 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 557/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:18:41 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:18:43.467548 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-19a44cad-a0bb-4d0c-b856-0a7de1af21f2 req-a46268fe-895f-467c-9efa-b9e087639128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549a64e4-c815-401b-a11b-20bb6e4ae5be", "tag": "0d26be27-92ac-4eef-84db-d207e3a196d3"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:43.478021 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-19a44cad-a0bb-4d0c-b856-0a7de1af21f2 req-a46268fe-895f-467c-9efa-b9e087639128 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:43.478500 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-19a44cad-a0bb-4d0c-b856-0a7de1af21f2 req-a46268fe-895f-467c-9efa-b9e087639128 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:43.478926 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-19a44cad-a0bb-4d0c-b856-0a7de1af21f2 req-a46268fe-895f-467c-9efa-b9e087639128 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:43.490334 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-19a44cad-a0bb-4d0c-b856-0a7de1af21f2 req-a46268fe-895f-467c-9efa-b9e087639128 service nova] Creating event network-changed:0d26be27-92ac-4eef-84db-d207e3a196d3 for instance 549a64e4-c815-401b-a11b-20bb6e4ae5be on hv-cinder-83976 Aug 30 12:18:43.495204 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-19a44cad-a0bb-4d0c-b856-0a7de1af21f2 req-a46268fe-895f-467c-9efa-b9e087639128 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031314 Aug 30 12:18:43.496133 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 546/1103] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:55.981354 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:18:55.981899 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:55.984484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:55.985180 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:55.990791 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:55.991274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:55.991713 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:55.992457 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:55.992953 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:55.998161 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:56.017302 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-387da85f-977a-4a42-a021-95fb659d3d17 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039809 Aug 30 12:18:56.017873 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 558/1104] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Aug 30 12:18:55 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:18:57.639888 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=19 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:57.640661 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=76 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:18:57.645070 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff4be8f4-640c-451a-8f7d-90118a800063"}} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:18:57.647688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:18:57.654461 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:57.655290 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:57.655489 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:57.656231 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:18:57.656681 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:18:57.657098 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:18:58.313563 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4b6c93fa-d124-449c-aa62-0f9cc03d5272 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "POST /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674969 Aug 30 12:18:58.314174 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 547/1105] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Aug 30 12:18:57 2022] POST /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:19:06.070134 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:06.070634 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:06.078367 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:06.078853 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:06.079294 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:06.080010 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:06.080469 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:06.080897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:06.162187 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lazy-loading 'services' on Instance uuid 488316a3-1995-4da7-b8d5-0519c35a75b1 {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:19:06.355533 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-b034723b-ac95-427a-965a-7f2e5c741b07 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments/ff4be8f4-640c-451a-8f7d-90118a800063" status: 202 len: 0 microversion: 2.1 time: 0.289104 Aug 30 12:19:06.356377 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 559/1106] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Aug 30 12:19:06 2022] DELETE /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments/ff4be8f4-640c-451a-8f7d-90118a800063 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:19:06.368144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:06.370514 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:06.376561 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:06.377054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:06.377466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:06.378183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:06.378643 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:06.379213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:06.409304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5731191a-4f29-4e9c-bde8-2d71e765a14f tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047508 Aug 30 12:19:06.410684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 548/1107] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:19:06 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:19:07.423483 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:07.426043 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:07.432326 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:07.432813 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:07.433280 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:07.433979 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:07.434432 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:07.434866 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:07.464524 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-8c2ee6f5-decf-4e3e-ba79-08a2e3da4414 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045865 Aug 30 12:19:07.465080 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 560/1108] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:19:07 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:19:08.487172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:08.487172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:08.487172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:08.487172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:08.488714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:08.488714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:08.488714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:08.488714 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:08.516922 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-bc199813-a129-49f3-b102-1156dd492250 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043993 Aug 30 12:19:08.517472 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 549/1109] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Aug 30 12:19:08 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 12:19:08.579166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:08.579755 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:08.586621 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:08.587095 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:08.587520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:08.588231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:08.588678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:08.589096 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:08.614087 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Going to try to terminate instance {{(pid=121191) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:19:08.875488 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-4d091656-1ffb-4027-a6a8-eeea0d85c3ea tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 204 len: 0 microversion: 2.1 time: 0.299834 Aug 30 12:19:08.876124 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 561/1110] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:19:08 2022] DELETE /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:19:08.884948 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:08.885559 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:08.891456 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:08.891919 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:08.892382 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:08.893065 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:08.893517 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:08.893977 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:09.027664 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:19:09.035996 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-4630638d-2e56-427c-a410-382af929f0e7 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1681 microversion: 2.1 time: 0.154971 Aug 30 12:19:09.036564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 550/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:08 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:19:10.057027 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:10.057649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:10.064136 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:10.064615 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:10.065046 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:10.066300 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:10.066749 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:10.067170 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:10.195198 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:19:10.202910 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-964bf852-9b53-401c-a5ef-c44f0f7a1973 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1681 microversion: 2.1 time: 0.150293 Aug 30 12:19:10.203477 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 562/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:10 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:19:11.249404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:11.249404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:11.249404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:11.249404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:11.250446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:11.250446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:11.250446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:11.250446 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:11.300689 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:19:11.308539 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-66321641-ab96-4560-94b7-4cbc98ca8eb6 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1613 microversion: 2.1 time: 0.088279 Aug 30 12:19:11.309110 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 551/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:11 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:19:11.481358 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-2d84e6b9-5196-45f5-8495-07798b33b750 req-d814b0f3-8684-436e-8957-1142c257b5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488316a3-1995-4da7-b8d5-0519c35a75b1", "name": "network-vif-deleted", "tag": "822cd088-1a2b-407e-aee5-0b40df2dfa41"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:19:11.492853 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2d84e6b9-5196-45f5-8495-07798b33b750 req-d814b0f3-8684-436e-8957-1142c257b5a0 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:11.494984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2d84e6b9-5196-45f5-8495-07798b33b750 req-d814b0f3-8684-436e-8957-1142c257b5a0 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:11.494984 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-2d84e6b9-5196-45f5-8495-07798b33b750 req-d814b0f3-8684-436e-8957-1142c257b5a0 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:11.505587 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-2d84e6b9-5196-45f5-8495-07798b33b750 req-d814b0f3-8684-436e-8957-1142c257b5a0 service nova] Creating event network-vif-deleted:822cd088-1a2b-407e-aee5-0b40df2dfa41 for instance 488316a3-1995-4da7-b8d5-0519c35a75b1 on hv-cinder-83976 Aug 30 12:19:11.510904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-2d84e6b9-5196-45f5-8495-07798b33b750 req-d814b0f3-8684-436e-8957-1142c257b5a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Aug 30 12:19:11.511718 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 563/1114] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:19:12.329812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:12.330502 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:12.342925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:12.343824 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:12.344711 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:12.346149 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:12.346995 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:12.347867 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:12.384028 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:12.384522 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:12.384963 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:12.385419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.objects.instance [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lazy-loading 'fault' on Instance uuid 488316a3-1995-4da7-b8d5-0519c35a75b1 {{(pid=121192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:19:12.426925 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5074689cd41c4bf0b47056ea436a609a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716103ef37a64f53ab58ec2a9b1a24e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:19:12.435013 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-8f7b986e-761a-4ba1-8e64-f4c3058abd9e tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 200 len: 1330 microversion: 2.1 time: 0.109013 Aug 30 12:19:12.436241 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 552/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:12 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:19:13.457949 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:13.458578 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:13.465231 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:13.465714 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:13.466149 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:13.466841 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:13.467330 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:13.467756 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:13.480785 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 HTTP/1.1 Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:19:13.482380 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:13.484147 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '488316a3-1995-4da7-b8d5-0519c35a75b1'} Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:13.485317 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:13.486935 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:13.489307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:13.489307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-bd11193e-c2d2-4376-82c5-84e1b2f3fcf9 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 404 len: 111 microversion: 2.1 time: 0.030357 Aug 30 12:19:13.489307 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 564/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:13 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:13.493634 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-1c82e0a6-6647-4277-8023-50a643d0d902 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '.version_select at 0x7efe4eee7700>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:13.579086 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-1c82e0a6-6647-4277-8023-50a643d0d902 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-576187228" status: 202 len: 0 microversion: 2.1 time: 0.089531 Aug 30 12:19:13.579647 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 553/1117] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Aug 30 12:19:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-576187228 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:19:15.767042 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:15.767538 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:15.774629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:15.775114 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:15.776271 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:15.776271 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:15.776697 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:15.777120 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:15.793917 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 HTTP/1.1 Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:19:15.795519 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.797216 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '488316a3-1995-4da7-b8d5-0519c35a75b1'} Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:15.798505 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.799796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.813422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:15.813422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-040345b9-ab39-4919-91b4-4ce7c46603f2 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 404 len: 111 microversion: 2.1 time: 0.033943 Aug 30 12:19:15.813422 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 565/1118] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:19:15 2022] DELETE /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:15.813792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:15.813792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 488316a3-1995-4da7-b8d5-0519c35a75b1] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:15.815374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:15.816613 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:15.817163 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:15.817686 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:15.818134 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:15.818552 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:15.832822 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 HTTP/1.1 Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:19:15.834466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.841173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '488316a3-1995-4da7-b8d5-0519c35a75b1'} Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:15.842166 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. Aug 30 12:19:15.843673 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:15.845667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 488316a3-1995-4da7-b8d5-0519c35a75b1 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:15.845667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-44ead282-f8da-418b-a9cc-ed630172ec49 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1" status: 404 len: 111 microversion: 2.1 time: 0.032778 Aug 30 12:19:15.845667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 554/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:15 2022] GET /compute/v2.1/servers/488316a3-1995-4da7-b8d5-0519c35a75b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:17.144934 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:17.145431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:17.151912 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.152421 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.152853 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.153532 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.153976 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.154411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.167897 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 HTTP/1.1 Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:19:17.169447 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.171097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '70d88dbf-62e5-46fb-acd9-8bce8ce4cb53'} Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:17.172202 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.173810 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.176099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:17.176099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-30e20f35-a099-4c33-9ed6-7ad82b4e1e41 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 404 len: 111 microversion: 2.1 time: 0.029883 Aug 30 12:19:17.176099 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 566/1120] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:19:17 2022] DELETE /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:17.179707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:17.180352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:17.186760 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.187248 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.187684 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.188402 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.188861 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.189289 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.203184 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 HTTP/1.1 Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:19:17.204723 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.206368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '70d88dbf-62e5-46fb-acd9-8bce8ce4cb53'} Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:17.207422 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. Aug 30 12:19:17.208729 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.210259 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:17.210259 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-3ed447f9-8622-480d-b612-4e622dec575c tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53" status: 404 len: 111 microversion: 2.1 time: 0.030790 Aug 30 12:19:17.210259 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 555/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:17 2022] GET /compute/v2.1/servers/70d88dbf-62e5-46fb-acd9-8bce8ce4cb53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:17.214943 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:17.215439 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:17.221562 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.223404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.223404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.223404 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.223715 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.224258 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.238271 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 HTTP/1.1 Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:19:17.240104 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.241773 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': 'c4ac18f1-5916-427c-afdf-a5c3bd612067'} Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:17.242647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.244156 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.247411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:17.247411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-650f3f48-52c0-4b92-8ae3-449c9e92a9db tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 404 len: 111 microversion: 2.1 time: 0.030489 Aug 30 12:19:17.247411 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 567/1122] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:19:17 2022] DELETE /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:17.250519 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:17.251163 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: c4ac18f1-5916-427c-afdf-a5c3bd612067] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:17.258252 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.258733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.259167 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.259853 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:17.260337 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:17.260769 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:17.274310 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 HTTP/1.1 Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:19:17.275836 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.277488 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': 'c4ac18f1-5916-427c-afdf-a5c3bd612067'} Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:17.278564 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. Aug 30 12:19:17.280111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:17.281813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance c4ac18f1-5916-427c-afdf-a5c3bd612067 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:17.281813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-586015dc-fdb8-4348-9d1a-a9904c78f2f3 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067" status: 404 len: 111 microversion: 2.1 time: 0.031183 Aug 30 12:19:17.281813 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 556/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:17 2022] GET /compute/v2.1/servers/c4ac18f1-5916-427c-afdf-a5c3bd612067 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:18.534270 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:18.534812 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:18.541290 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:18.541767 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:18.542197 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:18.542877 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:18.543324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:18.543743 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:18.557667 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.wsgi [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: request: DELETE /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 HTTP/1.1 Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept: application/json Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Accept-Encoding: identity Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Connection: close Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Length: 0 Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Content-Type: application/json Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Host: 10.222.0.42 Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Openstack-System-Scope: None Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Id: None Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Domain-Name: None Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Identity-Status: Confirmed Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Is-Admin-Project: True Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Id: default Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Domain-Name: Default Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Role: reader,member Aug 30 12:19:18.559211 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Roles: reader,member Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Id: default Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Domain-Name: Default Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: method: > Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: exception: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.560891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: action_args: {'id': '50cecfc5-00b5-4622-bdd8-146775076449'} Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:18.561862 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.563297 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.569707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. {{(pid=121191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:18.569707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7f17b12b-9628-4493-8349-704883c5f3bf tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 404 len: 111 microversion: 2.1 time: 0.030226 Aug 30 12:19:18.569707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 568/1124] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:19:18 2022] DELETE /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:19:18.570010 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:19:18.570450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] [instance: 50cecfc5-00b5-4622-bdd8-146775076449] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:19:18.576974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:18.577467 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:18.577908 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:18.578596 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:19:18.579054 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:19:18.579481 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:19:18.592892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] HTTP exception thrown: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Request method failure captured: Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 HTTP/1.1 Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf8KvgUQvSp0GdTytVNLHVvOyE5Npc-NpoSlA19j3wBlYNyJFYSA4_V-9G04k6gcjJXT_hhlp0tpqF2dkgTfzOsV2IghWiE5dy7jofacL3doyhdiY54WvDO4-rdVaSayNgjc5JSuOWqFWSLBbN9-vvDkn-10r1JS_rqT7ceVNnHCaHk Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:19:18.594404 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/716103ef37a64f53ab58ec2a9b1a24e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 716103ef37a64f53ab58ec2a9b1a24e1 Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-135345923 Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: 5074689cd41c4bf0b47056ea436a609a Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-AttachVolumeNegativeTest-135345923-project Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.596136 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '50cecfc5-00b5-4622-bdd8-146775076449'} Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:19:18.597105 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. Aug 30 12:19:18.600449 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:19:18.604375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] Returning 404 to user: Instance 50cecfc5-00b5-4622-bdd8-146775076449 could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:19:18.604375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9e588343-b124-445b-98ef-7df93c3a05e1 tempest-AttachVolumeNegativeTest-135345923 tempest-AttachVolumeNegativeTest-135345923-project] 10.222.0.42 "GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449" status: 404 len: 111 microversion: 2.1 time: 0.030627 Aug 30 12:19:18.604375 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 557/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:19:18 2022] GET /compute/v2.1/servers/50cecfc5-00b5-4622-bdd8-146775076449 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:20:38.436663 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:20:38.437409 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:20:38.442171 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:20:38.442702 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:38.450226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:38.450226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:38.450226 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:38.450603 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:38.450904 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:38.451325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:38.474894 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lazy-loading 'flavor' on Instance uuid 549a64e4-c815-401b-a11b-20bb6e4ae5be {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:20:38.742973 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-2ff79cad-f28c-4081-b0aa-c83b9059b968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "POST /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be/action" status: 202 len: 0 microversion: 2.1 time: 0.307884 Aug 30 12:20:38.743535 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 569/1126] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:20:38 2022] POST /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 12:20:38.749992 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:20:38.750722 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:20:38.752123 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 30 12:20:38.756667 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:38.757426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:38.764198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:38.764678 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:38.765111 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:38.765796 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:38.766246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:38.766662 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:38.899806 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:38.908324 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-873a9279-44ff-44c9-8761-fc0387828146 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.160150 Aug 30 12:20:38.909793 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 558/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:38 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:20:39.930591 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:39.931289 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:39.937738 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:39.938218 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:39.938648 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:39.939335 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:39.939850 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:39.940325 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:40.073454 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:40.082267 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-de59d802-b051-4434-bc83-6fdf194ca410 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.156598 Aug 30 12:20:40.082832 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 570/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:39 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:41.102569 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:41.103173 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:41.110831 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:41.111304 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:41.111733 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:41.112438 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:41.112885 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:41.113301 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:41.244955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:41.253246 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-cf20da3a-a85e-450d-9d69-7b8440b1aab3 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.154506 Aug 30 12:20:41.253803 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 559/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:41 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:42.274268 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:42.274875 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:42.280888 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:42.281366 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:42.281796 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:42.282501 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:42.282951 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:42.283365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:42.413671 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:42.422129 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6660c554-2870-4606-9763-f09645c2e459 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.151878 Aug 30 12:20:42.422699 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 571/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:42 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:43.443632 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:43.444283 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:43.451602 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:43.452125 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:43.452567 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:43.453258 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:43.453713 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:43.454141 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:43.592169 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:43.599992 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-88966b43-0158-4d99-bb0e-93c5b60800dd tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.160186 Aug 30 12:20:43.600570 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 560/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:43 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:44.625789 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:44.626419 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:44.633864 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:44.634344 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:44.634775 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:44.635468 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:44.635923 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:44.636373 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:44.765225 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:44.773445 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-39a5996e-4272-4060-b69d-f8f5f160790a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.151542 Aug 30 12:20:44.774019 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 572/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:44 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:45.795543 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:45.796169 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:45.803103 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:45.803577 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:45.804035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:45.804736 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:45.805183 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:45.805601 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:45.936625 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:45.945589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-5a29ae2e-9170-477c-b01d-2591e93a0965 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.153857 Aug 30 12:20:45.946268 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 561/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:45 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:46.967573 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:46.968145 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:46.975678 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:46.976185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:46.976624 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:46.977314 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:46.977770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:46.978204 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:47.114029 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:47.122492 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-dbb035cc-f150-4b1c-869f-3cc219f98968 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.159015 Aug 30 12:20:47.125305 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 573/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:46 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:48.144584 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:48.145144 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:48.151798 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:48.160701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:48.160701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:48.160701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:48.160701 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:48.161129 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:48.292792 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:48.300864 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-2ce20e84-ab0b-4993-9f33-29b6718d5742 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.160909 Aug 30 12:20:48.301465 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 562/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:48 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:49.321474 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:49.322122 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:49.328654 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:49.329133 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:49.329567 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:49.331277 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:49.331739 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:49.332205 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:49.460649 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:49.468284 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-34f8119d-0821-403b-bf9f-61535fa1a8cb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.150653 Aug 30 12:20:49.468850 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 574/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:49 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:50.490808 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:50.491417 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:50.497973 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:50.498457 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:50.498889 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:50.499573 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:50.500055 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:50.500479 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:50.630174 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:50.637786 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-9964fffa-fc93-4625-b40e-31bdb4f2026e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.151716 Aug 30 12:20:50.638361 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 563/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:50 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:51.658665 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:51.659280 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:51.667484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:51.667629 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:51.668014 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:51.668709 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:51.669966 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:51.670401 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:51.819078 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:51.826896 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-7d2277f0-0919-45a6-9604-987c572116d1 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.172137 Aug 30 12:20:51.827457 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 575/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:51 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:52.848320 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:52.849720 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:52.856139 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:52.856624 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:52.857060 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:52.857748 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:52.858206 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:52.858631 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:52.991352 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:52.999771 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-591f6410-0086-428c-a6f3-be2c7b4baf09 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.155146 Aug 30 12:20:53.004894 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 564/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:52 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:54.024020 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:54.024793 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:54.031719 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:54.032282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:54.032732 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:54.033431 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:54.033891 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:54.034318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:54.175365 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:54.185960 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-3dcff64f-2f2a-4a08-b211-863e8360157b tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.166095 Aug 30 12:20:54.200005 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 576/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:54 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:55.209147 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:55.209726 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:55.216000 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:55.216485 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:55.216911 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:55.217588 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:55.218035 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:55.218451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:55.351983 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:55.359775 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-208f1031-51a7-49ec-a113-892c4530005f tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1511 microversion: 2.1 time: 0.155158 Aug 30 12:20:55.360368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 565/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:55 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:55.380867 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:20:55.381459 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:55.387849 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:55.388357 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:55.388787 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:55.389467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:55.389914 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:55.390331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:55.530669 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121191) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 12:20:55.825540 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-43d3624d-665f-41af-86b9-759ddc721f74 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "POST /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be/action" status: 202 len: 0 microversion: 2.1 time: 0.448571 Aug 30 12:20:55.826148 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 577/1142] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Aug 30 12:20:55 2022] POST /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 12:20:55.835903 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:55.836063 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:55.842182 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:55.842672 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:55.843120 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:55.843876 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:55.846053 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:55.846461 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:55.987387 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:55.997800 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c6bf10e4-3a2d-4c49-957e-ff912000ab01 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1519 microversion: 2.1 time: 0.167229 Aug 30 12:20:55.998390 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 566/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:55 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:57.019274 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:57.019893 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:57.026957 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:57.027438 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:57.027875 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:57.028589 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:57.029041 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:57.029467 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:57.178255 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:57.187239 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-983a93eb-afcb-46dd-be1f-f321bf4fdcb0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1519 microversion: 2.1 time: 0.172458 Aug 30 12:20:57.187902 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 578/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:57 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:58.212226 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:58.213149 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:58.220755 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:58.221576 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:58.222370 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:58.223586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:58.224814 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:58.225515 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:58.402560 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:58.412435 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-476f1395-9106-4e45-8d6b-a9204c00636e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1521 microversion: 2.1 time: 0.205984 Aug 30 12:20:58.413142 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 567/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:58 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:20:58.897520 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-6164da07-e391-42c2-b898-9a9b6d2019be req-8a7742b9-d9a8-407f-a096-59ac8f0bf3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549a64e4-c815-401b-a11b-20bb6e4ae5be", "name": "network-vif-unplugged", "status": "completed", "tag": "0d26be27-92ac-4eef-84db-d207e3a196d3"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:20:58.908865 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6164da07-e391-42c2-b898-9a9b6d2019be req-8a7742b9-d9a8-407f-a096-59ac8f0bf3a8 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:58.912946 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6164da07-e391-42c2-b898-9a9b6d2019be req-8a7742b9-d9a8-407f-a096-59ac8f0bf3a8 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:58.912946 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-6164da07-e391-42c2-b898-9a9b6d2019be req-8a7742b9-d9a8-407f-a096-59ac8f0bf3a8 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:58.925886 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-6164da07-e391-42c2-b898-9a9b6d2019be req-8a7742b9-d9a8-407f-a096-59ac8f0bf3a8 service nova] Creating event network-vif-unplugged:0d26be27-92ac-4eef-84db-d207e3a196d3 for instance 549a64e4-c815-401b-a11b-20bb6e4ae5be on hv-cinder-83976 Aug 30 12:20:58.931413 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-6164da07-e391-42c2-b898-9a9b6d2019be req-8a7742b9-d9a8-407f-a096-59ac8f0bf3a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.205384 Aug 30 12:20:58.932068 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 579/1146] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 12:20:59.435465 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:20:59.436249 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:20:59.443106 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:59.443604 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:59.444080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:59.444778 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:20:59.445451 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:20:59.446077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:20:59.586620 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:20:59.595817 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c28598f3-c1d1-4532-bd51-a937629c2e6a tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.164955 Aug 30 12:20:59.596426 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 568/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:20:59 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:00.619005 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:00.619732 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:00.625843 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:00.626318 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:00.626747 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:00.627425 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:00.627870 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:00.628324 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:00.764460 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:00.773479 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-baa49546-5bdc-4c26-8c1f-30f5fef7e564 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.160028 Aug 30 12:21:00.774098 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 580/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:00 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:01.794696 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:01.795978 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:01.803490 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:01.803997 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:01.804607 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:01.805300 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:01.805751 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:01.806170 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:01.940674 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:01.948555 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-efdf4b84-9e90-4066-9794-cd65ede2d4d7 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.157740 Aug 30 12:21:01.949119 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 569/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:01 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:02.970353 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:02.970968 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:02.978145 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:02.978647 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:02.979072 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:02.979770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:02.980257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:02.980688 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:03.119758 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:03.128638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-072fca45-bcb7-4912-ba62-b445f98ae921 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.161438 Aug 30 12:21:03.128638 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 581/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:02 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:04.150466 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:04.151077 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:04.157461 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:04.157947 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:04.158384 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:04.159074 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:04.159531 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:04.159978 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:04.296429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:04.304540 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-e57dd078-2a64-424e-9f20-5c5e3526aeea tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.157993 Aug 30 12:21:04.305112 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 570/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:04 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:05.325795 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:05.326389 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:05.332873 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:05.337597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:05.337597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:05.337597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:05.337597 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:05.338008 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:05.465453 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:05.473246 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-6e743e47-4ecb-4d78-826b-169cf6ae8ccf tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.151608 Aug 30 12:21:05.474331 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 582/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:05 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 12:21:06.495575 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:06.496688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:06.510974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:06.510974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:06.510974 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:06.512213 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:06.512741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:06.513172 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:06.646707 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:06.657970 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-f27ea0e4-6822-4633-aa2c-afa4e06a57a4 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.167006 Aug 30 12:21:06.658741 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 571/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:06 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:07.680146 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:07.680755 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:07.687128 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:07.687602 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:07.690913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:07.690913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:07.690913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:07.690913 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:07.694174 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:21:07.823237 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:07.831283 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-0036a75c-5c80-487f-ad39-98bced0d30c0 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.155285 Aug 30 12:21:07.831854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 583/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:07 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:08.768757 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [req-6a31897c-af69-468f-9cb3-07c524ea6cb1 req-dd13256d-9c6c-40d9-a47b-dfb0350804fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549a64e4-c815-401b-a11b-20bb6e4ae5be", "name": "network-vif-plugged", "status": "completed", "tag": "0d26be27-92ac-4eef-84db-d207e3a196d3"}]} {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:21:08.780113 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6a31897c-af69-468f-9cb3-07c524ea6cb1 req-dd13256d-9c6c-40d9-a47b-dfb0350804fe service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:08.780788 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6a31897c-af69-468f-9cb3-07c524ea6cb1 req-dd13256d-9c6c-40d9-a47b-dfb0350804fe service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:08.781386 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [req-6a31897c-af69-468f-9cb3-07c524ea6cb1 req-dd13256d-9c6c-40d9-a47b-dfb0350804fe service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:08.792762 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.compute.server_external_events [req-6a31897c-af69-468f-9cb3-07c524ea6cb1 req-dd13256d-9c6c-40d9-a47b-dfb0350804fe service nova] Creating event network-vif-plugged:0d26be27-92ac-4eef-84db-d207e3a196d3 for instance 549a64e4-c815-401b-a11b-20bb6e4ae5be on hv-cinder-83976 Aug 30 12:21:08.797855 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [req-6a31897c-af69-468f-9cb3-07c524ea6cb1 req-dd13256d-9c6c-40d9-a47b-dfb0350804fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Aug 30 12:21:08.798443 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 572/1155] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:21:08.854418 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:08.855168 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:08.857670 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:21:08.863143 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:08.863784 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:08.864248 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:08.865892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:08.867166 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:08.867612 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:09.018751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:09.018751 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-183ec617-666f-4754-99a0-ab32b6c6f723 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.169470 Aug 30 12:21:09.019257 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 584/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:08 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:10.040514 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:10.041226 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:10.043176 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=31 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:21:10.048073 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:10.049447 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:10.049447 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:10.049761 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:10.050256 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:10.050678 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:10.187124 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:10.195782 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-13cbffd9-a8b8-4094-877f-5832d61a0b81 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1577 microversion: 2.1 time: 0.160290 Aug 30 12:21:10.198189 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 573/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:10 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:21:11.216539 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:21:11.217097 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:21:11.224185 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:11.228797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:11.228797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:11.228797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:21:11.228797 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:21:11.229282 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:21:11.357594 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:21:11.366206 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-ff7974f4-5b55-42ea-b06b-495766bc23a8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1564 microversion: 2.1 time: 0.152760 Aug 30 12:21:11.366772 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 585/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:21:11 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:22:24.280568 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_api:SELECT=1 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:22:24.281316 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG dbcounter [-] [121192] Writing DB stats nova_cell1:SELECT=92 {{(pid=121192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:22:24.282553 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 12:22:24.282710 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Tue Aug 30 12:22:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be (ip 10.222.0.42) !!! Aug 30 12:22:24.284233 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_api:SELECT=3 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:22:24.285069 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG dbcounter [-] [121191] Writing DB stats nova_cell1:SELECT=16 {{(pid=121191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 12:22:24.286685 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 12:22:24.286854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: Tue Aug 30 12:22:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Aug 30 12:22:24.297986 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:22:24.299424 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:22:24.305749 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:24.306955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:24.306955 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:24.307368 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:24.307812 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:24.308251 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:24.334527 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Going to try to terminate instance {{(pid=121192) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 12:22:24.485954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-c7b2a49d-d6dc-41f2-9a0e-676a0a5946be req-fa5979a8-d0f6-4d27-bda2-ba85c514b555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549a64e4-c815-401b-a11b-20bb6e4ae5be", "tag": "0d26be27-92ac-4eef-84db-d207e3a196d3"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:22:24.496089 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c7b2a49d-d6dc-41f2-9a0e-676a0a5946be req-fa5979a8-d0f6-4d27-bda2-ba85c514b555 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:24.496635 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c7b2a49d-d6dc-41f2-9a0e-676a0a5946be req-fa5979a8-d0f6-4d27-bda2-ba85c514b555 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:24.497091 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c7b2a49d-d6dc-41f2-9a0e-676a0a5946be req-fa5979a8-d0f6-4d27-bda2-ba85c514b555 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:24.508642 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-c7b2a49d-d6dc-41f2-9a0e-676a0a5946be req-fa5979a8-d0f6-4d27-bda2-ba85c514b555 service nova] Creating event network-changed:0d26be27-92ac-4eef-84db-d207e3a196d3 for instance 549a64e4-c815-401b-a11b-20bb6e4ae5be on hv-cinder-83976 Aug 30 12:22:24.514053 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-c7b2a49d-d6dc-41f2-9a0e-676a0a5946be req-fa5979a8-d0f6-4d27-bda2-ba85c514b555 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232123 Aug 30 12:22:24.514992 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 586/1159] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:22:24.594240 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-a454a757-f6df-4da2-b9c7-92a0a52f3c00 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "DELETE /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 204 len: 0 microversion: 2.1 time: 0.315995 Aug 30 12:22:24.598023 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 574/1160] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Aug 30 12:22:24 2022] DELETE /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 12:22:24.604001 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:22:24.604707 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:22:24.611920 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:24.614119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:24.614119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:24.614119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:24.614119 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:24.614507 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:24.750359 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:22:24.758193 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-f5c45447-bfaf-480a-b691-3aa80eb74b31 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.158833 Aug 30 12:22:24.758770 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 587/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:22:24 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:22:25.780977 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:22:25.781688 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:22:25.788344 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:25.788833 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:25.789265 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:25.789994 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:25.790450 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:25.790870 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:25.923772 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:22:25.931476 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-c86da542-dd20-453f-a709-c3fac1f575c9 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1570 microversion: 2.1 time: 0.156412 Aug 30 12:22:25.932061 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 575/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:22:25 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:22:26.870650 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [req-c5023bfa-2dee-4ddf-8bba-a09d0f20a955 req-b755be88-4c78-487b-9ebf-ec66769d0c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549a64e4-c815-401b-a11b-20bb6e4ae5be", "name": "network-vif-deleted", "tag": "0d26be27-92ac-4eef-84db-d207e3a196d3"}]} {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 12:22:26.881470 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c5023bfa-2dee-4ddf-8bba-a09d0f20a955 req-b755be88-4c78-487b-9ebf-ec66769d0c46 service nova] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:26.882854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c5023bfa-2dee-4ddf-8bba-a09d0f20a955 req-b755be88-4c78-487b-9ebf-ec66769d0c46 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:26.882854 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [req-c5023bfa-2dee-4ddf-8bba-a09d0f20a955 req-b755be88-4c78-487b-9ebf-ec66769d0c46 service nova] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:26.895203 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.compute.server_external_events [req-c5023bfa-2dee-4ddf-8bba-a09d0f20a955 req-b755be88-4c78-487b-9ebf-ec66769d0c46 service nova] Creating event network-vif-deleted:0d26be27-92ac-4eef-84db-d207e3a196d3 for instance 549a64e4-c815-401b-a11b-20bb6e4ae5be on hv-cinder-83976 Aug 30 12:22:26.899806 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [req-c5023bfa-2dee-4ddf-8bba-a09d0f20a955 req-b755be88-4c78-487b-9ebf-ec66769d0c46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033180 Aug 30 12:22:26.900415 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 588/1163] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Aug 30 12:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 12:22:26.953306 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:22:26.953910 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:22:26.960429 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:26.961151 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:26.961589 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:26.962283 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:26.962780 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:26.963210 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:27.026906 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.policy [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121192) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:22:27.035705 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-28e44b56-125c-47f7-9920-1c7b2fbf8693 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1383 microversion: 2.1 time: 0.086679 Aug 30 12:22:27.036305 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 576/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:22:26 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1383 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:22:28.057882 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:22:28.058552 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.compute.api [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121191) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:22:28.065196 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:28.065674 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:28.066101 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:28.066943 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:28.067395 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:28.067905 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:28.102140 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:28.102621 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:28.103047 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG oslo_concurrency.lockutils [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:28.103484 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.objects.instance [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lazy-loading 'fault' on Instance uuid 549a64e4-c815-401b-a11b-20bb6e4ae5be {{(pid=121191) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 12:22:28.146588 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.policy [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de686f2ada0647399fecfc50b41c8120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e12097423d476a84a6f0dd7e83fe06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121191) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 12:22:28.155356 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-630b685d-c6f9-4160-90a1-23e06c6e3d5e tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 200 len: 1225 microversion: 2.1 time: 0.102196 Aug 30 12:22:28.155954 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 589/1165] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:22:28 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 12:22:29.176080 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '>' {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:22:29.176686 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.compute.api [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] [instance: 549a64e4-c815-401b-a11b-20bb6e4ae5be] Fetching instance by UUID {{(pid=121192) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 12:22:29.182985 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:29.183464 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:29.183892 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:29.184747 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Acquiring lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 12:22:29.185198 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 12:22:29.185619 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG oslo_concurrency.lockutils [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Lock "e804add6-fad7-42aa-9329-3e6b3bd26b8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 12:22:29.198476 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.wsgi [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] HTTP exception thrown: Instance 549a64e4-c815-401b-a11b-20bb6e4ae5be could not be found. Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Request method failure captured: Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: request: GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be HTTP/1.1 Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept: application/json Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Accept-Encoding: identity Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Connection: close Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Length: 0 Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Content-Type: application/json Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Host: 10.222.0.42 Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: Openstack-System-Scope: None Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: User-Agent: python-urllib3/1.26.12 Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Auth-Token: gAAAAABjDf_x6vLlVmPkiWxX2KvWOgVF4qhVoQdZWsjtv6aRzlGUbD66aaNNtO0cjoxbjSAUqy6XGIzsG0EFQ7ZJddMXydgFZq5KieeSjkHlP8e9xzwU1mgryH1QKF0EGcPa77ju_4mtswMdh0WWacYxAjBygPFcLQv6k1GW645pAP4q_SFP1wc Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Id: None Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Domain-Name: None Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Identity-Status: Confirmed Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Is-Admin-Project: True Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Id: default Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Domain-Name: Default Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Id: 73e12097423d476a84a6f0dd7e83fe06 Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Project-Name: tempest-TestShelveInstance-1430877619 Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Role: reader,member Aug 30 12:22:29.200212 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Roles: reader,member Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73e12097423d476a84a6f0dd7e83fe06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73e12097423d476a84a6f0dd7e83fe06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73e12097423d476a84a6f0dd7e83fe06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73e12097423d476a84a6f0dd7e83fe06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant: tempest-TestShelveInstance-1430877619 Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Id: 73e12097423d476a84a6f0dd7e83fe06 Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-Tenant-Name: tempest-TestShelveInstance-1430877619 Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User: tempest-TestShelveInstance-1430877619-project Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Id: default Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Domain-Name: Default Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Id: de686f2ada0647399fecfc50b41c8120 Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: X-User-Name: tempest-TestShelveInstance-1430877619-project Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: method: > Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: exception: Instance 549a64e4-c815-401b-a11b-20bb6e4ae5be could not be found. Aug 30 12:22:29.201837 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: action_args: {'id': '549a64e4-c815-401b-a11b-20bb6e4ae5be'} Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: {{(pid=121192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549a64e4-c815-401b-a11b-20bb6e4ae5be could not be found. Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 12:22:29.203586 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549a64e4-c815-401b-a11b-20bb6e4ae5be could not be found. Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549a64e4-c815-401b-a11b-20bb6e4ae5be could not be found. Aug 30 12:22:29.205419 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: ERROR nova.api.openstack.wsgi Aug 30 12:22:29.207374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: DEBUG nova.api.openstack.wsgi [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Returning 404 to user: Instance 549a64e4-c815-401b-a11b-20bb6e4ae5be could not be found. {{(pid=121192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 12:22:29.207374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: INFO nova.api.openstack.requestlog [None req-573fa42d-8b80-44fa-ad0e-4077bb5032fb tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be" status: 404 len: 111 microversion: 2.1 time: 0.029394 Aug 30 12:22:29.207374 dv-cinder-839768-2-iscsi devstack@n-api.service[121192]: [pid: 121192|app: 0|req: 577/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Aug 30 12:22:29 2022] GET /compute/v2.1/servers/549a64e4-c815-401b-a11b-20bb6e4ae5be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 12:22:29.427150 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: DEBUG nova.api.openstack.wsgi [None req-70304284-e244-4c20-aaca-b1374b3f73d8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] Calling method '.version_select at 0x7efe4f3abaf0>' {{(pid=121191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 12:22:29.546892 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: INFO nova.api.openstack.requestlog [None req-70304284-e244-4c20-aaca-b1374b3f73d8 tempest-TestShelveInstance-1430877619 tempest-TestShelveInstance-1430877619-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1828409437" status: 202 len: 0 microversion: 2.1 time: 0.123548 Aug 30 12:22:29.547536 dv-cinder-839768-2-iscsi devstack@n-api.service[121191]: [pid: 121191|app: 0|req: 590/1167] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Aug 30 12:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1828409437 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)